2024-01-21T07:27:40.033 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-21T07:27:40.033 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236 --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} --verbose -- /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/orig.config.yaml 2024-01-21T07:27:40.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T07:27:40.145 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236 branch: wip-yuri4-testing-2024-01-18-1257-pacific description: rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} email: yweinste@redhat.com first_in_suite: false job_id: '7524236' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2024-01-18-1257-pacific ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec workunit: branch: wip-yuri4-testing-2024-01-18-1257-pacific sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 8186 sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2024-01-18-1257-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - cephadm: add_mons_via_daemon_add: true allow_ptrace: false avoid_pacific_features: true cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 --port=8000 - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-19_23:17:02 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-21T07:27:40.146 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa; will attempt to use it 2024-01-21T07:27:40.146 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa/tasks 2024-01-21T07:27:40.146 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-21T07:27:40.148 INFO:teuthology.task.internal:Checking packages... 2024-01-21T07:27:40.172 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec' 2024-01-21T07:27:40.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-21T07:27:40.172 INFO:teuthology.packaging:ref: None 2024-01-21T07:27:40.172 INFO:teuthology.packaging:tag: None 2024-01-21T07:27:40.172 INFO:teuthology.packaging:branch: wip-yuri4-testing-2024-01-18-1257-pacific 2024-01-21T07:27:40.172 INFO:teuthology.packaging:sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:27:40.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2024-01-18-1257-pacific 2024-01-21T07:27:40.317 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-454-gea310589-1focal 2024-01-21T07:27:40.318 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-21T07:27:40.327 INFO:teuthology.task.internal:no buildpackages task found 2024-01-21T07:27:40.327 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-21T07:27:40.342 INFO:teuthology.task.internal:Saving configuration 2024-01-21T07:27:40.353 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-21T07:27:40.364 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T07:27:40.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 07:21:34.704896', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-01-21T07:27:40.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 07:21:34.703152', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-01-21T07:27:40.410 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-21T07:27:40.422 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-01-21T07:27:40.422 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-01-21T07:27:40.422 INFO:teuthology.run_tasks:Running task console_log... 2024-01-21T07:27:40.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f331e5435e0>, signals=[15]) 2024-01-21T07:27:40.500 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-21T07:27:40.509 INFO:teuthology.task.internal:Opening connections... 2024-01-21T07:27:40.509 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-01-21T07:27:40.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:27:40.600 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-01-21T07:27:40.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:27:40.688 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-21T07:27:40.697 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-01-21T07:27:40.704 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-01-21T07:27:40.704 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-01-21T07:27:40.753 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2024-01-21T07:27:40.753 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-01-21T07:27:40.753 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2024-01-21T07:27:40.753 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2024-01-21T07:27:40.753 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="20.04" 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=focal 2024-01-21T07:27:40.754 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=focal 2024-01-21T07:27:40.754 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-01-21T07:27:40.775 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-01-21T07:27:40.782 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-01-21T07:27:40.782 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="20.04" 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-21T07:27:40.832 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-21T07:27:40.833 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-21T07:27:40.833 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=focal 2024-01-21T07:27:40.833 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=focal 2024-01-21T07:27:40.833 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-01-21T07:27:40.858 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-21T07:27:40.867 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-21T07:27:40.880 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-21T07:27:40.880 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-01-21T07:27:40.883 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-01-21T07:27:40.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-21T07:27:40.897 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-21T07:27:40.897 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-01-21T07:27:40.929 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-01-21T07:27:40.945 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-21T07:27:41.012 INFO:teuthology.run_tasks:Running task kernel... 2024-01-21T07:27:41.032 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-21T07:27:41.032 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-21T07:27:41.032 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-21T07:27:41.033 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-21T07:27:41.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T07:27:41.038 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-01-21T07:27:41.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T07:27:41.039 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-01-21T07:27:41.046 INFO:teuthology.orchestra.run.smithi195.stdout:5.4.0-124-generic 2024-01-21T07:27:41.046 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.4.0-124-generic 2024-01-21T07:27:41.046 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get clean 2024-01-21T07:27:41.085 INFO:teuthology.orchestra.run.smithi080.stdout:5.4.0-124-generic 2024-01-21T07:27:41.085 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.4.0-124-generic 2024-01-21T07:27:41.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-01-21T07:27:41.188 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-01-21T07:27:41.200 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-01-21T07:27:41.386 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-01-21T07:27:41.386 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-01-21T07:27:41.389 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-01-21T07:27:41.427 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-01-21T07:27:41.427 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-01-21T07:27:41.435 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-01-21T07:27:41.566 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-01-21T07:27:41.639 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-01-21T07:27:41.790 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,647 kB] 2024-01-21T07:27:41.828 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,647 kB] 2024-01-21T07:27:41.907 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [920 kB] 2024-01-21T07:27:41.974 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [920 kB] 2024-01-21T07:27:42.030 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [694 kB] 2024-01-21T07:27:42.039 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [406 kB] 2024-01-21T07:27:42.045 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-01-21T07:27:42.045 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,461 kB] 2024-01-21T07:27:42.065 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [694 kB] 2024-01-21T07:27:42.068 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,028 kB] 2024-01-21T07:27:42.076 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [406 kB] 2024-01-21T07:27:42.088 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-01-21T07:27:42.088 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,461 kB] 2024-01-21T07:27:42.184 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [35.1 kB] 2024-01-21T07:27:42.186 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [343 kB] 2024-01-21T07:27:42.191 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-01-21T07:27:42.191 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [929 kB] 2024-01-21T07:27:42.206 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [640 kB] 2024-01-21T07:27:42.212 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [35.1 kB] 2024-01-21T07:27:42.212 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [343 kB] 2024-01-21T07:27:42.214 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [195 kB] 2024-01-21T07:27:42.216 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-01-21T07:27:42.216 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2024-01-21T07:27:42.216 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-01-21T07:27:42.217 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-01-21T07:27:42.217 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [929 kB] 2024-01-21T07:27:42.223 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [640 kB] 2024-01-21T07:27:42.236 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [195 kB] 2024-01-21T07:27:42.241 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-01-21T07:27:42.242 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2024-01-21T07:27:42.242 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-01-21T07:27:42.244 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,028 kB] 2024-01-21T07:27:42.263 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [489 kB] 2024-01-21T07:27:42.270 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-01-21T07:27:42.270 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,579 kB] 2024-01-21T07:27:42.294 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-01-21T07:27:42.295 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-01-21T07:27:42.303 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-01-21T07:27:42.303 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-01-21T07:27:42.310 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.4 kB] 2024-01-21T07:27:42.310 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [360 kB] 2024-01-21T07:27:42.316 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-01-21T07:27:42.316 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [768 kB] 2024-01-21T07:27:42.326 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,154 kB] 2024-01-21T07:27:42.342 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [277 kB] 2024-01-21T07:27:42.346 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-01-21T07:27:42.346 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-01-21T07:27:42.346 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-01-21T07:27:42.361 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-01-21T07:27:42.362 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-01-21T07:27:42.362 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-01-21T07:27:42.362 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-01-21T07:27:42.381 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [489 kB] 2024-01-21T07:27:42.389 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-01-21T07:27:42.389 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.4 kB] 2024-01-21T07:27:42.390 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,579 kB] 2024-01-21T07:27:42.401 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-01-21T07:27:42.402 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-01-21T07:27:42.402 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-01-21T07:27:42.403 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-01-21T07:27:42.434 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [360 kB] 2024-01-21T07:27:42.438 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-01-21T07:27:42.438 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,154 kB] 2024-01-21T07:27:42.456 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [768 kB] 2024-01-21T07:27:42.468 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [277 kB] 2024-01-21T07:27:42.471 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-01-21T07:27:42.472 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-01-21T07:27:42.472 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-01-21T07:27:42.472 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-01-21T07:27:42.492 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-01-21T07:27:42.492 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-01-21T07:27:42.493 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-01-21T07:27:42.494 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-01-21T07:27:42.494 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-01-21T07:27:42.494 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-01-21T07:27:42.495 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-01-21T07:27:46.020 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 18.6 MB in 3s (6,612 kB/s) 2024-01-21T07:27:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 18.6 MB in 3s (6,580 kB/s) 2024-01-21T07:27:47.452 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-01-21T07:27:47.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-21T07:27:47.494 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-21T07:27:47.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-21T07:27:47.542 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-01-21T07:27:47.595 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-21T07:27:47.722 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-01-21T07:27:47.723 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-01-21T07:27:47.799 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-21T07:27:47.799 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-21T07:27:47.901 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-01-21T07:27:47.901 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-5.4.0-169 linux-headers-5.4.0-169-generic 2024-01-21T07:27:47.901 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-generic linux-image-5.4.0-169-generic 2024-01-21T07:27:47.901 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-5.4.0-169-generic linux-modules-extra-5.4.0-169-generic 2024-01-21T07:27:47.903 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-01-21T07:27:47.903 INFO:teuthology.orchestra.run.smithi080.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-01-21T07:27:47.903 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-01-21T07:27:47.903 INFO:teuthology.orchestra.run.smithi080.stdout: thermald 2024-01-21T07:27:47.953 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-01-21T07:27:47.953 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-5.4.0-169 linux-headers-5.4.0-169-generic 2024-01-21T07:27:47.953 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-169-generic linux-modules-5.4.0-169-generic 2024-01-21T07:27:47.953 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-extra-5.4.0-169-generic 2024-01-21T07:27:47.955 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages will be upgraded: 2024-01-21T07:27:47.955 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-21T07:27:47.983 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-01-21T07:27:47.983 INFO:teuthology.orchestra.run.smithi195.stdout: linux-generic linux-headers-5.4.0-169 linux-headers-5.4.0-169-generic 2024-01-21T07:27:47.983 INFO:teuthology.orchestra.run.smithi195.stdout: linux-headers-generic linux-image-5.4.0-169-generic 2024-01-21T07:27:47.983 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-5.4.0-169-generic linux-modules-extra-5.4.0-169-generic 2024-01-21T07:27:47.984 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-01-21T07:27:47.984 INFO:teuthology.orchestra.run.smithi195.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-01-21T07:27:47.984 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2024-01-21T07:27:47.984 INFO:teuthology.orchestra.run.smithi195.stdout: thermald 2024-01-21T07:27:48.048 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-01-21T07:27:48.048 INFO:teuthology.orchestra.run.smithi195.stdout: linux-headers-5.4.0-169 linux-headers-5.4.0-169-generic 2024-01-21T07:27:48.049 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-169-generic linux-modules-5.4.0-169-generic 2024-01-21T07:27:48.049 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-extra-5.4.0-169-generic 2024-01-21T07:27:48.050 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-01-21T07:27:48.050 INFO:teuthology.orchestra.run.smithi195.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-21T07:27:48.108 INFO:teuthology.orchestra.run.smithi195.stdout:3 upgraded, 5 newly installed, 0 to remove and 282 not upgraded. 2024-01-21T07:27:48.109 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 77.1 MB of archives. 2024-01-21T07:27:48.109 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 380 MB of additional disk space will be used. 2024-01-21T07:27:48.109 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-169-generic amd64 5.4.0-169.187 [15.0 MB] 2024-01-21T07:27:48.149 INFO:teuthology.orchestra.run.smithi080.stdout:3 upgraded, 5 newly installed, 0 to remove and 282 not upgraded. 2024-01-21T07:27:48.149 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 77.1 MB of archives. 2024-01-21T07:27:48.149 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 380 MB of additional disk space will be used. 2024-01-21T07:27:48.149 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-169-generic amd64 5.4.0-169.187 [15.0 MB] 2024-01-21T07:27:48.425 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-169-generic amd64 5.4.0-169.187 [10.5 MB] 2024-01-21T07:27:48.520 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-169-generic amd64 5.4.0-169.187 [39.2 MB] 2024-01-21T07:27:49.082 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.169.167 [1,900 B] 2024-01-21T07:27:49.082 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.169.167 [2,520 B] 2024-01-21T07:27:49.082 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-169 all 5.4.0-169.187 [11.0 MB] 2024-01-21T07:27:49.269 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-169-generic amd64 5.4.0-169.187 [1,374 kB] 2024-01-21T07:27:49.289 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-169-generic amd64 5.4.0-169.187 [10.5 MB] 2024-01-21T07:27:49.291 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.169.167 [2,392 B] 2024-01-21T07:27:49.561 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-169-generic amd64 5.4.0-169.187 [39.2 MB] 2024-01-21T07:27:50.027 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 77.1 MB in 1s (62.5 MB/s) 2024-01-21T07:27:50.217 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-modules-5.4.0-169-generic. 2024-01-21T07:27:50.867 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.169.167 [1,900 B] 2024-01-21T07:27:50.868 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.169.167 [2,520 B] 2024-01-21T07:27:50.868 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-169 all 5.4.0-169.187 [11.0 MB] 2024-01-21T07:27:51.155 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-169-generic amd64 5.4.0-169.187 [1,374 kB] 2024-01-21T07:27:51.190 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.169.167 [2,392 B] 2024-01-21T07:27:51.900 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 77.1 MB in 3s (23.9 MB/s) 2024-01-21T07:27:51.960 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-01-21T07:27:51.965 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../0-linux-modules-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:27:52.069 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-5.4.0-169-generic. 2024-01-21T07:27:52.080 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-modules-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:27:53.814 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-01-21T07:27:53.819 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../0-linux-modules-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:27:53.942 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:27:54.039 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-5.4.0-169-generic. 2024-01-21T07:27:54.052 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../1-linux-image-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:27:54.157 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:27:55.225 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-169-generic. 2024-01-21T07:27:55.240 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:27:55.284 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-modules-extra-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:27:55.927 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-image-5.4.0-169-generic. 2024-01-21T07:27:55.941 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../1-linux-image-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:27:56.055 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:27:57.155 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-169-generic. 2024-01-21T07:27:57.169 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:27:57.247 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-extra-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:00.221 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../3-linux-generic_5.4.0.169.167_amd64.deb ... 2024-01-21T07:28:00.347 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-generic (5.4.0.169.167) over (5.4.0.124.125) ... 2024-01-21T07:28:00.714 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.169.167_amd64.deb ... 2024-01-21T07:28:00.834 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-generic (5.4.0.169.167) over (5.4.0.124.125) ... 2024-01-21T07:28:01.196 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-headers-5.4.0-169. 2024-01-21T07:28:01.213 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../5-linux-headers-5.4.0-169_5.4.0-169.187_all.deb ... 2024-01-21T07:28:01.254 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-5.4.0-169 (5.4.0-169.187) ... 2024-01-21T07:28:02.330 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../3-linux-generic_5.4.0.169.167_amd64.deb ... 2024-01-21T07:28:02.457 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-generic (5.4.0.169.167) over (5.4.0.124.125) ... 2024-01-21T07:28:02.784 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.169.167_amd64.deb ... 2024-01-21T07:28:02.911 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-generic (5.4.0.169.167) over (5.4.0.124.125) ... 2024-01-21T07:28:03.272 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.4.0-169. 2024-01-21T07:28:03.285 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../5-linux-headers-5.4.0-169_5.4.0-169.187_all.deb ... 2024-01-21T07:28:03.355 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.4.0-169 (5.4.0-169.187) ... 2024-01-21T07:28:06.832 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-headers-5.4.0-169-generic. 2024-01-21T07:28:06.855 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../6-linux-headers-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:28:06.898 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:08.822 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.4.0-169-generic. 2024-01-21T07:28:08.843 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../6-linux-headers-5.4.0-169-generic_5.4.0-169.187_amd64.deb ... 2024-01-21T07:28:08.872 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:09.552 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.169.167_amd64.deb ... 2024-01-21T07:28:09.672 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-generic (5.4.0.169.167) over (5.4.0.124.125) ... 2024-01-21T07:28:10.040 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-5.4.0-169 (5.4.0-169.187) ... 2024-01-21T07:28:10.169 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:10.311 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-modules-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:11.522 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:11.644 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.169.167_amd64.deb ... 2024-01-21T07:28:11.771 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-generic (5.4.0.169.167) over (5.4.0.124.125) ... 2024-01-21T07:28:12.122 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.4.0-169 (5.4.0-169.187) ... 2024-01-21T07:28:12.251 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:12.394 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:12.708 INFO:teuthology.orchestra.run.smithi195.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-169-generic 2024-01-21T07:28:12.708 INFO:teuthology.orchestra.run.smithi195.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-generic (5.4.0.169.167) ... 2024-01-21T07:28:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-modules-extra-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:14.159 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-generic (5.4.0.169.167) ... 2024-01-21T07:28:14.302 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-generic (5.4.0.169.167) ... 2024-01-21T07:28:14.368 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for linux-image-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-21T07:28:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:15.542 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-169-generic 2024-01-21T07:28:15.542 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:15.709 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-generic (5.4.0.169.167) ... 2024-01-21T07:28:15.836 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-extra-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:16.995 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-generic (5.4.0.169.167) ... 2024-01-21T07:28:17.096 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-generic (5.4.0.169.167) ... 2024-01-21T07:28:17.223 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for linux-image-5.4.0-169-generic (5.4.0-169.187) ... 2024-01-21T07:28:17.290 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-21T07:28:17.290 INFO:teuthology.orchestra.run.smithi080.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:36.379 INFO:teuthology.orchestra.run.smithi195.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-21T07:28:36.379 INFO:teuthology.orchestra.run.smithi195.stdout:Sourcing file `/etc/default/grub' 2024-01-21T07:28:36.386 INFO:teuthology.orchestra.run.smithi195.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-21T07:28:36.404 INFO:teuthology.orchestra.run.smithi195.stdout:Generating grub configuration file ... 2024-01-21T07:28:36.716 INFO:teuthology.orchestra.run.smithi195.stdout:Found linux image: /boot/vmlinuz-5.4.0-169-generic 2024-01-21T07:28:36.741 INFO:teuthology.orchestra.run.smithi195.stdout:Found initrd image: /boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:37.144 INFO:teuthology.orchestra.run.smithi195.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-21T07:28:37.155 INFO:teuthology.orchestra.run.smithi195.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-21T07:28:39.000 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-21T07:28:39.000 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub' 2024-01-21T07:28:39.007 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-21T07:28:39.026 INFO:teuthology.orchestra.run.smithi080.stdout:Generating grub configuration file ... 2024-01-21T07:28:39.228 INFO:teuthology.orchestra.run.smithi195.stdout:done 2024-01-21T07:28:39.356 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.4.0-169-generic 2024-01-21T07:28:39.382 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:39.645 DEBUG:teuthology.orchestra.run.smithi195:> dpkg -s linux-image-generic 2024-01-21T07:28:39.708 INFO:teuthology.orchestra.run.smithi195.stdout:Package: linux-image-generic 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Status: install ok installed 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Priority: optional 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Section: kernel 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Installed-Size: 20 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Maintainer: Ubuntu Kernel Team 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: amd64 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Source: linux-meta 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Version: 5.4.0.169.167 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Depends: linux-image-5.4.0-169-generic, linux-modules-extra-5.4.0-169-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Recommends: thermald 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:Description: Generic Linux kernel image 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout: This package will always depend on the latest generic kernel image 2024-01-21T07:28:39.709 INFO:teuthology.orchestra.run.smithi195.stdout: available. 2024-01-21T07:28:39.710 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-169-generic 2024-01-21T07:28:39.710 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-21T07:28:39.710 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-21T07:28:39.710 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-21T07:28:39.710 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-01-21T07:28:39.710 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get clean 2024-01-21T07:28:39.798 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-21T07:28:39.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-01-21T07:28:39.809 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-21T07:28:39.965 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-01-21T07:28:40.075 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-01-21T07:28:40.184 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-01-21T07:28:40.203 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-01-21T07:28:41.742 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-21T07:28:41.767 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-21T07:28:41.837 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-21T07:28:41.986 INFO:teuthology.orchestra.run.smithi080.stdout:done 2024-01-21T07:28:42.018 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-21T07:28:42.018 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-21T07:28:42.229 INFO:teuthology.orchestra.run.smithi195.stdout:linux-image-generic is already the newest version (5.4.0.169.167). 2024-01-21T07:28:42.230 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 0 newly installed, 0 to remove and 282 not upgraded. 2024-01-21T07:28:42.232 DEBUG:teuthology.orchestra.run.smithi195:> dpkg -s linux-image-generic 2024-01-21T07:28:42.254 INFO:teuthology.orchestra.run.smithi195.stdout:Package: linux-image-generic 2024-01-21T07:28:42.254 INFO:teuthology.orchestra.run.smithi195.stdout:Status: install ok installed 2024-01-21T07:28:42.254 INFO:teuthology.orchestra.run.smithi195.stdout:Priority: optional 2024-01-21T07:28:42.254 INFO:teuthology.orchestra.run.smithi195.stdout:Section: kernel 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Installed-Size: 20 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Maintainer: Ubuntu Kernel Team 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: amd64 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Source: linux-meta 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Version: 5.4.0.169.167 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Depends: linux-image-5.4.0-169-generic, linux-modules-extra-5.4.0-169-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Recommends: thermald 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout:Description: Generic Linux kernel image 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout: This package will always depend on the latest generic kernel image 2024-01-21T07:28:42.255 INFO:teuthology.orchestra.run.smithi195.stdout: available. 2024-01-21T07:28:42.256 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-01-21T07:28:42.261 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.coBXcqCAWy 2024-01-21T07:28:42.261 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub/grub.cfg /tmp/tmp.coBXcqCAWy 2024-01-21T07:28:42.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.coBXcqCAWy 2024-01-21T07:28:42.374 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.coBXcqCAWy is 9KB 2024-01-21T07:28:42.389 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.coBXcqCAWy 2024-01-21T07:28:42.396 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-21T07:28:42.400 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-01-21T07:28:42.456 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:28:42.456 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-21T07:28:42.456 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-21T07:28:42.460 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 20 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.4.0.169.167 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.4.0-169-generic, linux-modules-extra-5.4.0-169-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-01-21T07:28:42.461 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-01-21T07:28:42.462 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-169-generic 2024-01-21T07:28:42.462 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-21T07:28:42.462 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-21T07:28:42.462 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-21T07:28:42.462 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-01-21T07:28:42.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-01-21T07:28:42.492 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-169-generic 2024-01-21T07:28:42.492 DEBUG:teuthology.orchestra.run.smithi195:> sudo update-grub 2024-01-21T07:28:42.533 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-01-21T07:28:42.668 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-01-21T07:28:42.676 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-01-21T07:28:42.696 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-01-21T07:28:42.781 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-01-21T07:28:43.820 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-01-21T07:28:43.827 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-21T07:28:43.841 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-01-21T07:28:44.135 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-169-generic 2024-01-21T07:28:44.146 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:44.451 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-01-21T07:28:44.476 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-21T07:28:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-01-21T07:28:44.549 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-21T07:28:44.561 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-21T07:28:44.747 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-01-21T07:28:44.748 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-01-21T07:28:44.972 INFO:teuthology.orchestra.run.smithi080.stdout:linux-image-generic is already the newest version (5.4.0.169.167). 2024-01-21T07:28:44.973 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 0 newly installed, 0 to remove and 282 not upgraded. 2024-01-21T07:28:44.975 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-01-21T07:28:44.994 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-01-21T07:28:44.994 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-01-21T07:28:44.994 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-01-21T07:28:44.994 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-01-21T07:28:44.994 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 20 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.4.0.169.167 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.4.0-169-generic, linux-modules-extra-5.4.0-169-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-01-21T07:28:44.995 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-01-21T07:28:44.995 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-01-21T07:28:44.999 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.vSVTT6PsyC 2024-01-21T07:28:45.000 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vSVTT6PsyC 2024-01-21T07:28:45.059 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.vSVTT6PsyC 2024-01-21T07:28:45.089 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.vSVTT6PsyC is 9KB 2024-01-21T07:28:45.103 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.vSVTT6PsyC 2024-01-21T07:28:45.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-21T07:28:45.166 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:28:45.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-21T07:28:45.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-21T07:28:45.199 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-169-generic 2024-01-21T07:28:45.199 DEBUG:teuthology.orchestra.run.smithi080:> sudo update-grub 2024-01-21T07:28:45.523 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-01-21T07:28:45.524 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-01-21T07:28:46.561 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub' 2024-01-21T07:28:46.566 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-21T07:28:46.574 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-01-21T07:28:46.850 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.4.0-169-generic 2024-01-21T07:28:46.862 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.4.0-169-generic 2024-01-21T07:28:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-01-21T07:28:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-01-21T07:28:48.268 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-01-21T07:28:48.270 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-01-21T07:29:15.552 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-21T07:29:15.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-21T07:29:15.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:29:18.276 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-21T07:29:18.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:29:18.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:29:34.012 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-01-21T07:29:36.828 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-21T07:29:43.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-21T07:29:43.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:29:45.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:29:45.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:29:46.080 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-01-21T07:29:48.892 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-21T07:29:58.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-21T07:29:58.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:30:00.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:30:00.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:30:19.324 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-01-21T07:30:29.823 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-01-21T07:30:30.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-21T07:30:30.347 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-169-generic"... 2024-01-21T07:30:30.347 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-01-21T07:30:30.353 INFO:teuthology.orchestra.run.smithi195.stdout:5.4.0-169-generic 2024-01-21T07:30:30.353 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-169-generic vs 5.4.0-169-generic 2024-01-21T07:30:30.353 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-21T07:30:30.353 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-21T07:30:31.354 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-21T07:30:31.354 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-21T07:30:31.451 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-01-21T07:30:31.473 DEBUG:teuthology.parallel:result is None 2024-01-21T07:30:34.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:30:34.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:30:34.569 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-01-21T07:30:35.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:30:35.163 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-169-generic"... 2024-01-21T07:30:35.164 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-01-21T07:30:35.170 INFO:teuthology.orchestra.run.smithi080.stdout:5.4.0-169-generic 2024-01-21T07:30:35.170 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-169-generic vs 5.4.0-169-generic 2024-01-21T07:30:35.170 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-21T07:30:35.170 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-21T07:30:36.171 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-21T07:30:36.172 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-21T07:30:36.274 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-01-21T07:30:36.301 DEBUG:teuthology.parallel:result is None 2024-01-21T07:30:36.302 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-21T07:30:36.309 INFO:teuthology.task.internal:Creating test directory... 2024-01-21T07:30:36.309 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-21T07:30:36.311 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-21T07:30:36.319 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-21T07:30:36.325 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-21T07:30:36.333 INFO:teuthology.task.internal:Creating archive directory... 2024-01-21T07:30:36.333 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-21T07:30:36.336 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-21T07:30:36.603 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-21T07:30:36.610 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-21T07:30:36.610 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-21T07:30:36.612 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-21T07:30:36.628 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T07:30:36.630 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T07:30:36.638 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T07:30:36.640 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T07:30:36.642 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-21T07:30:36.650 INFO:teuthology.task.internal:Configuring sudo... 2024-01-21T07:30:36.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-21T07:30:36.652 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-21T07:30:36.668 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-21T07:30:36.677 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-21T07:30:36.677 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-21T07:30:36.679 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-21T07:30:36.718 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-21T07:30:36.733 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-21T07:30:36.740 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:30:36.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-21T07:30:36.766 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-21T07:30:36.773 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-21T07:30:36.780 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:30:36.780 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-21T07:30:36.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-01-21T07:30:36.850 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-01-21T07:30:36.899 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-21T07:30:36.907 INFO:teuthology.task.internal:Starting timer... 2024-01-21T07:30:36.907 INFO:teuthology.run_tasks:Running task pcp... 2024-01-21T07:30:36.917 INFO:teuthology.run_tasks:Running task selinux... 2024-01-21T07:30:36.925 DEBUG:teuthology.task.selinux:Excluding smithi080: OS 'ubuntu' does not support SELinux 2024-01-21T07:30:36.925 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2024-01-21T07:30:36.925 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-21T07:30:36.925 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-21T07:30:36.925 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-21T07:30:36.925 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-21T07:30:36.934 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-21T07:30:36.951 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-21T07:30:36.953 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-21T07:35:49.498 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-01-21T07:35:49.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:35:49.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:35:49.604 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-01-21T07:35:49.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-01-21T07:35:49.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-21T07:35:49.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T07:35:49.819 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-01-21T07:35:49.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-21T07:35:49.946 INFO:teuthology.run_tasks:Running task clock... 2024-01-21T07:35:49.956 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-21T07:35:49.957 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-21T07:35:49.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T07:35:49.959 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-21T07:35:49.959 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T07:35:49.990 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-01-21T07:35:49.990 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Command line: ntpd -gq 2024-01-21T07:35:49.992 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: proto: precision = 0.293 usec (-22) 2024-01-21T07:35:49.992 INFO:teuthology.orchestra.run.smithi080.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-21T07:35:49.992 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-21T07:35:49.992 INFO:teuthology.orchestra.run.smithi080.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-21T07:35:49.993 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: restrict ::: KOD does nothing without LIMITED. 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listen and drop on 0 v6wildcard [::]:123 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listen normally on 2 lo 127.0.0.1:123 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listen normally on 3 enp3s0f1 172.21.15.80:123 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listen normally on 4 lo [::1]:123 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba9%5]:123 2024-01-21T07:35:49.994 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:49 ntpd[12743]: Listening on routing socket on fd #22 for interface updates 2024-01-21T07:35:50.024 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-01-21T07:35:50.024 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Command line: ntpd -gq 2024-01-21T07:35:50.026 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: proto: precision = 0.116 usec (-23) 2024-01-21T07:35:50.026 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-21T07:35:50.026 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-21T07:35:50.027 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: restrict ::: KOD does nothing without LIMITED. 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listen and drop on 0 v6wildcard [::]:123 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listen normally on 2 lo 127.0.0.1:123 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listen normally on 4 lo [::1]:123 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2024-01-21T07:35:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:50 ntpd[12762]: Listening on routing socket on fd #22 for interface updates 2024-01-21T07:35:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:50 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:50.991 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:50 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:51 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:51.025 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:51 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:51.991 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:51 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:53.025 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:53 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.025 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:53 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.025 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:53 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.025 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:53 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:53 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:53.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:53 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:53.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:53.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:53 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:55.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:55.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:55 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:55.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:55.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:55 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:57.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:57.028 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:57 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:57.991 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:57.992 INFO:teuthology.orchestra.run.smithi080.stdout:21 Jan 07:35:57 ntpd[12743]: ntpd: time slew +0.000343 s 2024-01-21T07:35:57.993 INFO:teuthology.orchestra.run.smithi080.stdout:ntpd: time slew +0.000343s 2024-01-21T07:35:57.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-21T07:35:57.993 INFO:teuthology.orchestra.run.smithi080.stderr:21 Jan 07:35:57 ntpd[12743]: can't open /var/log/ntpstats/loopstats.20240121: Permission denied 2024-01-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-01-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-01-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi080.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi080.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi080.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:59.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:59.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:59.026 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/rawstats.20240121: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-21T07:35:59.027 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/peerstats.20240121: Permission denied 2024-01-21T07:35:59.028 INFO:teuthology.orchestra.run.smithi195.stdout:21 Jan 07:35:59 ntpd[12762]: ntpd: time slew +0.000506 s 2024-01-21T07:35:59.028 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew +0.000506s 2024-01-21T07:35:59.028 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-21T07:35:59.028 INFO:teuthology.orchestra.run.smithi195.stderr:21 Jan 07:35:59 ntpd[12762]: can't open /var/log/ntpstats/loopstats.20240121: Permission denied 2024-01-21T07:35:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-01-21T07:35:59.084 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-01-21T07:35:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-01-21T07:35:59.085 INFO:teuthology.run_tasks:Running task cephadm... 2024-01-21T07:35:59.159 INFO:tasks.cephadm:Config: {'add_mons_via_daemon_add': True, 'allow_ptrace': False, 'avoid_pacific_features': True, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'} 2024-01-21T07:35:59.159 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2024-01-21T07:35:59.160 INFO:tasks.cephadm:Cluster fsid is b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:35:59.160 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-01-21T07:35:59.160 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.80', 'mon.c': '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]', 'mon.b': '172.21.15.195'} 2024-01-21T07:35:59.161 INFO:tasks.cephadm:First mon is mon.a on smithi080 2024-01-21T07:35:59.161 INFO:tasks.cephadm:First mgr is y 2024-01-21T07:35:59.161 INFO:tasks.cephadm:Normalizing hostnames... 2024-01-21T07:35:59.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-01-21T07:35:59.178 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-01-21T07:35:59.196 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2024-01-21T07:35:59.196 DEBUG:teuthology.orchestra.run.smithi080:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-21T07:35:59.614 INFO:teuthology.orchestra.run.smithi080.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Jan 21 07:35 /home/ubuntu/cephtest/cephadm 2024-01-21T07:35:59.615 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-21T07:35:59.766 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Jan 21 07:35 /home/ubuntu/cephtest/cephadm 2024-01-21T07:35:59.766 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-21T07:35:59.775 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-21T07:35:59.797 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-01-21T07:35:59.836 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-01-21T07:35:59.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-01-21T07:35:59.867 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-01-21T07:35:59.912 INFO:tasks.cephadm:Writing seed config... 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-01-21T07:35:59.913 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-01-21T07:35:59.914 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:35:59.914 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-01-21T07:35:59.921 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b86415d2-b82f-11ee-95b0-87774f69a715 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-01-21T07:35:59.921 DEBUG:teuthology.orchestra.run.smithi080:mon.a> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service 2024-01-21T07:35:59.924 DEBUG:teuthology.orchestra.run.smithi080:mgr.y> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service 2024-01-21T07:35:59.926 INFO:tasks.cephadm:Bootstrapping... 2024-01-21T07:35:59.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid b86415d2-b82f-11ee-95b0-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.80 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:36:00.034 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Could not locate podman: podman not found 2024-01-21T07:36:00.035 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Verifying podman|docker is present... 2024-01-21T07:36:00.035 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Verifying lvm2 is present... 2024-01-21T07:36:00.035 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Verifying time synchronization is in place... 2024-01-21T07:36:00.035 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-01-21T07:36:00.040 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-21T07:36:00.044 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-01-21T07:36:00.047 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.047 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-01-21T07:36:00.053 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-01-21T07:36:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-01-21T07:36:00.057 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2024-01-21T07:36:00.063 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout masked 2024-01-21T07:36:00.063 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2024-01-21T07:36:00.068 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.068 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2024-01-21T07:36:00.073 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-01-21T07:36:00.073 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2024-01-21T07:36:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2024-01-21T07:36:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-01-21T07:36:00.085 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2024-01-21T07:36:00.091 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout active 2024-01-21T07:36:00.091 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2024-01-21T07:36:00.091 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Repeating the final host check... 2024-01-21T07:36:00.091 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:podman|docker (/usr/bin/docker) is present 2024-01-21T07:36:00.092 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:systemctl is present 2024-01-21T07:36:00.092 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:lvcreate is present 2024-01-21T07:36:00.092 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-01-21T07:36:00.097 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-21T07:36:00.097 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-01-21T07:36:00.103 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.103 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-01-21T07:36:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-01-21T07:36:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-01-21T07:36:00.115 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.115 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2024-01-21T07:36:00.122 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout masked 2024-01-21T07:36:00.122 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2024-01-21T07:36:00.128 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.129 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2024-01-21T07:36:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-01-21T07:36:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2024-01-21T07:36:00.140 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-01-21T07:36:00.141 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2024-01-21T07:36:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-01-21T07:36:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2024-01-21T07:36:00.154 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stdout active 2024-01-21T07:36:00.155 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2024-01-21T07:36:00.155 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Host looks OK 2024-01-21T07:36:00.155 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:root:Cluster fsid: b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:00.155 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Acquiring lock 140594175682736 on /run/cephadm/b86415d2-b82f-11ee-95b0-87774f69a715.lock 2024-01-21T07:36:00.155 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Lock 140594175682736 acquired on /run/cephadm/b86415d2-b82f-11ee-95b0-87774f69a715.lock 2024-01-21T07:36:00.156 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Verifying IP 172.21.15.80 port 3300 ... 2024-01-21T07:36:00.156 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Verifying IP 172.21.15.80 port 6789 ... 2024-01-21T07:36:00.156 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.80, final addrv is [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-01-21T07:36:00.156 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/sbin/ip route ls 2024-01-21T07:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp3s0f1 2024-01-21T07:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.80 metric 100 2024-01-21T07:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-01-21T07:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.80 2024-01-21T07:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.80 metric 100 2024-01-21T07:36:00.161 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Mon IP 172.21.15.80 is in CIDR network 172.21.0.0/20 2024-01-21T07:36:00.162 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2024-01-21T07:36:00.162 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.0 2024-01-21T07:36:00.432 INFO:journalctl@ceph.mgr.y.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:36:00.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:36:03.910 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout v15.2.0: Pulling from ceph/ceph 2024-01-21T07:36:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pulling fs layer 2024-01-21T07:36:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pulling fs layer 2024-01-21T07:36:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Verifying Checksum 2024-01-21T07:36:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Download complete 2024-01-21T07:36:08.151 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Verifying Checksum 2024-01-21T07:36:08.151 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Download complete 2024-01-21T07:36:09.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pull complete 2024-01-21T07:36:22.104 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pull complete 2024-01-21T07:36:22.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Digest: sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60 2024-01-21T07:36:22.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Status: Downloaded newer image for ceph/ceph:v15.2.0 2024-01-21T07:36:22.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/docker:stdout docker.io/ceph/ceph:v15.2.0 2024-01-21T07:36:22.316 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2024-01-21T07:36:22.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2024-01-21T07:36:22.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2024-01-21T07:36:33.200 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:stat:stdout 167 167 2024-01-21T07:36:33.771 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Creating initial keys... 2024-01-21T07:36:33.771 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-01-21T07:36:33.771 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-01-21T07:36:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCCyaxlyomxGxAAHXF7NoNywWmsCfBE12StZA== 2024-01-21T07:36:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-01-21T07:36:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-01-21T07:36:35.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCDyaxlt1EcKhAAWPnukOWabJAOPq3Vc2L/Cw== 2024-01-21T07:36:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-01-21T07:36:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-01-21T07:36:37.005 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCFyaxlzu46ABAAzZt6VWc5TrOKSLRcp148kQ== 2024-01-21T07:36:37.509 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Creating initial monmap... 2024-01-21T07:36:37.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/tmp/ceph-tmpgyiy5x19:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', 'b86415d2-b82f-11ee-95b0-87774f69a715', '--addv', 'a', '[v2:172.21.15.80:3300,v1:172.21.15.80:6789]', '/tmp/monmap'] 2024-01-21T07:36:37.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /tmp/ceph-tmpgyiy5x19:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid b86415d2-b82f-11ee-95b0-87774f69a715 --addv a [v2:172.21.15.80:3300,v1:172.21.15.80:6789] /tmp/monmap 2024-01-21T07:36:38.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-21T07:36:38.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:38.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-21T07:36:38.771 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Creating mon... 2024-01-21T07:36:38.774 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpsh7lz472:/tmp/keyring:z', '-v', '/tmp/ceph-tmpgyiy5x19:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', 'b86415d2-b82f-11ee-95b0-87774f69a715', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2024-01-21T07:36:38.774 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpsh7lz472:/tmp/keyring:z -v /tmp/ceph-tmpgyiy5x19:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-01-21T07:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-01-21T07:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 1 imported monmap: 2024-01-21T07:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2024-01-21T07:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2024-01-21T07:36:38.219076+0000 2024-01-21T07:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2024-01-21T07:36:38.219076+0000 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 /usr/bin/ceph-mon: set fsid to b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:36:39.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.463+0000 7f817d8fc6c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:36:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: RocksDB version: 6.1.2 2024-01-21T07:36:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:36:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Compile date Mar 23 2020 2024-01-21T07:36:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: DB SUMMARY 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.create_if_missing: 1 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.env: 0x55aaa32fc1a0 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.info_log: 0x55aaa49c7a80 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:36:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.db_log_dir: 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:36:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.write_buffer_manager: 0x55aaa5568120 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:36:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.row_cache: None 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.wal_filter: None 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:36:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:36:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Compression algorithms supported: 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kZSTD supported: 0 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-01-21T07:36:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.merge_operator: 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55aaa48f0130) 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2024-01-21T07:36:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55aaa4926510 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2024-01-21T07:36:39.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:36:39.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.num_levels: 7 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:36:39.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:36:39.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:36:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:36:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.467+0000 7f817d8fc6c0 4 rocksdb: Options.ttl: 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.471+0000 7f817d8fc6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.471+0000 7f817d8fc6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.471+0000 7f817d8fc6c0 4 rocksdb: DB pointer 0x55aaa49c2400 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.471+0000 7f8166abd700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.471+0000 7f8166abd700 4 rocksdb: [db/db_impl.cc:778] 2024-01-21T07:36:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:36:39.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:36:39.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:36:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.475+0000 7f817d8fc6c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.475+0000 7f817d8fc6c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2024-01-21T07:36:39.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-01-21T07:36:39.475+0000 7f817d8fc6c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-01-21T07:36:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:40.042 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2024-01-21T07:36:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2024-01-21T07:36:40.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-01-21T07:36:40.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2024-01-21T07:36:40.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target 2024-01-21T07:36:40.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target -> /etc/systemd/system/ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target. 2024-01-21T07:36:40.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target -> /etc/systemd/system/ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target. 2024-01-21T07:36:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl start ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target 2024-01-21T07:36:40.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-01-21T07:36:40.804 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a 2024-01-21T07:36:40.814 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a 2024-01-21T07:36:40.820 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service: Unit ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service not loaded. 2024-01-21T07:36:40.820 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a 2024-01-21T07:36:40.827 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target.wants/ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service -> /etc/systemd/system/ceph-b86415d2-b82f-11ee-95b0-87774f69a715@.service. 2024-01-21T07:36:41.028 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl start ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a 2024-01-21T07:36:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:firewalld does not appear to be present 2024-01-21T07:36:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for mon to start... 2024-01-21T07:36:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for mon... 2024-01-21T07:36:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2024-01-21T07:36:41.087 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:41 smithi080 docker[13445]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.a 2024-01-21T07:36:41.088 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:41 smithi080 systemd[1]: Started Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:36:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.230057s) 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2024-01-21T07:36:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2024-01-21T07:36:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:42.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:42 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.231232+0000 mon.a (mon.0) 0 : [INF] mkfs b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:42.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:42 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.214749+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-01-21T07:36:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2024-01-21T07:36:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2024-01-21T07:36:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z -v /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2024-01-21T07:36:43.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:43 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.226703+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-01-21T07:36:43.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:43 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.228225+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} 2024-01-21T07:36:43.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:43 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.234640+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-01-21T07:36:43.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:43 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.242979+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-01-21T07:36:43.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:43 smithi080 bash[13468]: cluster 2024-01-21T07:36:42.244473+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-01-21T07:36:43.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:43 smithi080 bash[13468]: audit 2024-01-21T07:36:42.456696+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.80:0/2995648293' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2024-01-21T07:36:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mon] 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim = false 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_memory_target_autotune = true 2024-01-21T07:36:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2024-01-21T07:36:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:44 smithi080 bash[13468]: audit 2024-01-21T07:36:43.999662+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.80:0/1179739754' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-21T07:36:44.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:44 smithi080 bash[13468]: audit 2024-01-21T07:36:44.003574+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.80:0/1179739754' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-01-21T07:36:44.621 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2024-01-21T07:36:44.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2024-01-21T07:36:44.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z -v /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2024-01-21T07:36:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:45 smithi080 bash[13468]: audit 2024-01-21T07:36:45.609579+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.80:0/2766405262' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:36:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Restarting the monitor... 2024-01-21T07:36:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a 2024-01-21T07:36:46.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:46 smithi080 systemd[1]: Stopping Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:36:46.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:46 smithi080 bash[13468]: debug 2024-01-21T07:36:46.283+0000 7fc3cb204700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:36:46.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:46 smithi080 bash[13468]: debug 2024-01-21T07:36:46.283+0000 7fc3cb204700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-21T07:36:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:46 smithi080 docker[13861]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.a 2024-01-21T07:36:47.110 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Setting mon public_network... 2024-01-21T07:36:47.110 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2024-01-21T07:36:47.110 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2024-01-21T07:36:47.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:47 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service: Succeeded. 2024-01-21T07:36:47.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:47 smithi080 systemd[1]: Stopped Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:36:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:47 smithi080 systemd[1]: Starting Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:36:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:47 smithi080 docker[13898]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.a 2024-01-21T07:36:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:47 smithi080 systemd[1]: Started Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.059+0000 7f74e1d3d6c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.059+0000 7f74e1d3d6c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.059+0000 7f74e1d3d6c0 0 pidfile_write: ignore empty --pid-file 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 load: jerasure load: lrc load: isa 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:36:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 1 rocksdb: do_open column families: [default] 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: RocksDB version: 6.1.2 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Compile date Mar 23 2020 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: DB SUMMARY 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: CURRENT file: CURRENT 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: IDENTITY file: IDENTITY 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69139 ; 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.create_if_missing: 0 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.env: 0x55baade061a0 2024-01-21T07:36:48.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.info_log: 0x55baaeee89a0 2024-01-21T07:36:48.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:36:48.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:36:48.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:36:48.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.db_log_dir: 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.write_buffer_manager: 0x55baafa82ae0 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:36:48.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.row_cache: None 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.wal_filter: None 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:36:48.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:36:48.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Compression algorithms supported: 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kZSTD supported: 0 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:36:48.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.merge_operator: 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55baaee08138) 2024-01-21T07:36:48.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cache_index_and_filter_blocks: 1 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cache_index_and_filter_blocks_with_high_priority: 1 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: pin_top_level_index_and_filter: 1 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: index_type: 0 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: data_block_index_type: 0 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: hash_index_allow_collision: 1 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: checksum: 1 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: no_block_cache: 0 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_cache: 0x55baaee3e610 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_cache_name: BinnedLRUCache 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_cache_options: 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: capacity : 536870912 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: num_shard_bits : 4 2024-01-21T07:36:48.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: strict_capacity_limit : 0 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: high_pri_pool_ratio: 0.000 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_cache_compressed: (nil) 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: persistent_cache: (nil) 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_size: 4096 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_size_deviation: 10 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_restart_interval: 16 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: index_block_restart_interval: 1 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: metadata_block_size: 4096 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: partition_filters: 0 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: use_delta_encoding: 1 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: whole_key_filtering: 1 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: verify_compression: 0 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: read_amp_bytes_per_bit: 0 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: format_version: 2 2024-01-21T07:36:48.319 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: enable_index_compression: 1 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: block_align: 0 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.num_levels: 7 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:36:48.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:36:48.321 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:36:48.322 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:36:48.323 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:36:48.323 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:36:48.323 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:36:48.323 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:36:48.323 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:36:48.324 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:36:48.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: Options.ttl: 0 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822608070184, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.063+0000 7f74e1d3d6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74e1d3d6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822608071188, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66244, "table_properties": {"data_size": 64539, "index_size": 310, "filter_size": 581, "raw_key_size": 8630, "raw_average_key_size": 46, "raw_value_size": 59555, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74e1d3d6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74e1d3d6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822608071717, "job": 1, "event": "recovery_finished"} 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74e1d3d6c0 4 rocksdb: DB pointer 0x55baaeed9200 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74c8e8a700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74c8e8a700 4 rocksdb: [db/db_impl.cc:778] 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** DB Stats ** 2024-01-21T07:36:48.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** Compaction Stats [default] ** 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: L0 2/0 66.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Sum 2/0 66.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** Compaction Stats [default] ** 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:48.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Cumulative compaction: 0.00 GB write, 16.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Interval compaction: 0.00 GB write, 16.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** Compaction Stats [default] ** 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:48.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: L0 2/0 66.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Sum 2/0 66.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** Compaction Stats [default] ** 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 94.4 0.00 0.00 1 0.001 0 0 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:36:48.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Cumulative compaction: 0.00 GB write, 16.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.067+0000 7f74e1d3d6c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 1 mon.a@-1(???) e1 preinit fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 0 mon.a@-1(???).mds e1 new map 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 0 mon.a@-1(???).mds e1 print_map 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: e1 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: enable_multiple, ever_enabled_multiple: 0,0 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: legacy client fscid: -1 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: 2024-01-21T07:36:48.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: No filesystems configured 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: audit 2024-01-21T07:36:45.609579+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.80:0/2766405262' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expand map: {default=false} 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta from 'false' to 'false' 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expanded map: {default=false} 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expand map: {default=info} 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta from 'info' to 'info' 2024-01-21T07:36:48.331 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expanded map: {default=info} 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expand map: {default=daemon} 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta from 'daemon' to 'daemon' 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expanded map: {default=daemon} 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expand map: {default=debug} 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta from 'debug' to 'debug' 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: debug 2024-01-21T07:36:48.071+0000 7f74e1d3d6c0 20 expand_channel_meta expanded map: {default=debug} 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cluster 2024-01-21T07:36:48.080580+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cluster 2024-01-21T07:36:48.080644+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cluster 2024-01-21T07:36:48.080683+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cluster 2024-01-21T07:36:48.080707+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-01-21T07:36:48.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:48 smithi080 bash[13909]: cluster 2024-01-21T07:36:48.081132+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-01-21T07:36:48.968 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Creating mgr... 2024-01-21T07:36:48.970 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-01-21T07:36:49.156 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y 2024-01-21T07:36:49.166 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y 2024-01-21T07:36:49.172 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service: Unit ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service not loaded. 2024-01-21T07:36:49.172 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y 2024-01-21T07:36:49.176 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-b86415d2-b82f-11ee-95b0-87774f69a715.target.wants/ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service -> /etc/systemd/system/ceph-b86415d2-b82f-11ee-95b0-87774f69a715@.service. 2024-01-21T07:36:49.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:49 smithi080 bash[13909]: audit 2024-01-21T07:36:48.335832+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.80:0/4280225252' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2024-01-21T07:36:49.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:49 smithi080 bash[13909]: audit 2024-01-21T07:36:48.341189+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.80:0/4280225252' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2024-01-21T07:36:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: systemctl start ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:firewalld does not appear to be present 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for mgr to start... 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for mgr... 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-01-21T07:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-01-21T07:36:49.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:36:49 smithi080 docker[14146]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.y 2024-01-21T07:36:49.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:36:49 smithi080 systemd[1]: Started Ceph mgr.y for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:36:50.786 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "b86415d2-b82f-11ee-95b0-87774f69a715", 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-01-21T07:36:50.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-01-21T07:36:50.788 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-01-21T07:36:50.792 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-01-21T07:36:50.793 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:50.794 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-01-21T07:36:42.232227+0000", 2024-01-21T07:36:50.794 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-01-21T07:36:50.794 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:50.794 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-01-21T07:36:50.794 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:36:51.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:50 smithi080 bash[13909]: audit 2024-01-21T07:36:50.781567+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.80:0/74805244' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-21T07:36:51.400 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2024-01-21T07:36:52.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-01-21T07:36:52.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-01-21T07:36:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:36:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "b86415d2-b82f-11ee-95b0-87774f69a715", 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-01-21T07:36:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 5, 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-01-21T07:36:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-01-21T07:36:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-01-21T07:36:42.232227+0000", 2024-01-21T07:36:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-01-21T07:36:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-01-21T07:36:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:36:53.954 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2024-01-21T07:36:54.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:54 smithi080 bash[13909]: audit 2024-01-21T07:36:53.376534+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.80:0/3270070794' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-21T07:36:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-01-21T07:36:54.956 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-01-21T07:36:55.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: cluster 2024-01-21T07:36:54.836421+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: cluster 2024-01-21T07:36:54.843142+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00697356s) 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: audit 2024-01-21T07:36:54.844860+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: audit 2024-01-21T07:36:54.845370+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: audit 2024-01-21T07:36:54.845792+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: audit 2024-01-21T07:36:54.846962+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: audit 2024-01-21T07:36:54.847376+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:36:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:55 smithi080 bash[13909]: cluster 2024-01-21T07:36:54.851111+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2024-01-21T07:36:55.951 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "b86415d2-b82f-11ee-95b0-87774f69a715", 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:55.952 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 2, 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-01-21T07:36:55.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-01-21T07:36:55.957 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-01-21T07:36:55.957 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-01-21T07:36:55.957 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-01-21T07:36:55.957 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.957 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-01-21T07:36:55.957 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.958 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-01-21T07:36:42.232227+0000", 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-01-21T07:36:55.959 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:36:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Enabling cephadm module... 2024-01-21T07:36:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2024-01-21T07:36:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2024-01-21T07:36:56.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:54.873789+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-01-21T07:36:56.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.303440+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-01-21T07:36:56.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: cluster 2024-01-21T07:36:55.303565+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-01-21T07:36:56.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.310799+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:36:56.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.315630+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"b112f75e-bf40-4ff2-9e6e-c5d7aa1ae428"}]: dispatch 2024-01-21T07:36:56.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.318175+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"b112f75e-bf40-4ff2-9e6e-c5d7aa1ae428"}]': finished 2024-01-21T07:36:56.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.318677+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"08440eeb-2b2a-4ff7-9b91-171eb0ef6617"}]: dispatch 2024-01-21T07:36:56.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.321462+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"08440eeb-2b2a-4ff7-9b91-171eb0ef6617"}]': finished 2024-01-21T07:36:56.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: cluster 2024-01-21T07:36:55.848886+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.01272s) 2024-01-21T07:36:56.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:56 smithi080 bash[13909]: audit 2024-01-21T07:36:55.946382+0000 mon.a (mon.0) 27 : audit [DBG] from='client.? 172.21.15.80:0/1463476294' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-21T07:36:57.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:57 smithi080 bash[13909]: audit 2024-01-21T07:36:56.313037+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 172.21.15.80:0/1260759688' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:36:57.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:57 smithi080 bash[13909]: cluster 2024-01-21T07:36:56.313135+0000 mon.a (mon.0) 29 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-01-21T07:36:57.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:57 smithi080 bash[13909]: audit 2024-01-21T07:36:56.322958+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-21T07:36:57.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:57 smithi080 bash[13909]: audit 2024-01-21T07:36:57.216495+0000 mon.a (mon.0) 31 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-21T07:36:58.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:58 smithi080 bash[13909]: cluster 2024-01-21T07:36:57.323366+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-01-21T07:36:58.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:58 smithi080 bash[13909]: audit 2024-01-21T07:36:57.692354+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.80:0/3259186556' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-01-21T07:36:58.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:36:58 smithi080 bash[14168]: ignoring --setuser ceph since I am not root 2024-01-21T07:36:58.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:36:58 smithi080 bash[14168]: ignoring --setgroup ceph since I am not root 2024-01-21T07:36:58.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:36:58 smithi080 bash[14168]: debug 2024-01-21T07:36:58.367+0000 7f4fb363e040 1 -- 172.21.15.80:0/275801079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5644118e6800 msgr2=0x56441188ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T07:36:58.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:36:58 smithi080 bash[14168]: debug 2024-01-21T07:36:58.367+0000 7f4fb363e040 1 --2- 172.21.15.80:0/275801079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5644118e6800 0x56441188ba80 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x5644118ae420 tx=0x5644118b0d70).stop 2024-01-21T07:36:58.934 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-01-21T07:36:58.935 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-01-21T07:36:59.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:59 smithi080 bash[13909]: audit 2024-01-21T07:36:58.339598+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.80:0/3259186556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-01-21T07:36:59.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:36:59 smithi080 bash[13909]: cluster 2024-01-21T07:36:58.339736+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 3s) 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:00.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:6800", 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 941119075 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:6801", 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 941119075 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.80:6801/941119075", 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-01-21T07:36:54.836141+0000", 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-01-21T07:37:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-01-21T07:37:00.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-01-21T07:37:00.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-01-21T07:37:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-01-21T07:37:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-01-21T07:37:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-01-21T07:37:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-01-21T07:37:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-01-21T07:37:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-01-21T07:37:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-01-21T07:37:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-01-21T07:37:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-01-21T07:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-01-21T07:37:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-01-21T07:37:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-01-21T07:37:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-01-21T07:37:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-21T07:37:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-01-21T07:37:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.524 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.525 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.526 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.529 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.530 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.531 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.532 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-21T07:37:00.533 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.534 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.535 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-01-21T07:37:00.536 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.537 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.538 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.539 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.540 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.542 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.543 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.544 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.550 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.551 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.552 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.553 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.554 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-01-21T07:37:00.555 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-01-21T07:37:00.556 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-01-21T07:37:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.560 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-01-21T07:37:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-01-21T07:37:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-01-21T07:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-01-21T07:37:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-01-21T07:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-01-21T07:37:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-01-21T07:37:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.578 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.579 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.580 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.581 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.582 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.583 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:00.584 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.585 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.586 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.587 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.588 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.589 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.590 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.591 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.592 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.593 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.594 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.595 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-01-21T07:37:00.596 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-01-21T07:37:00.597 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-01-21T07:37:00.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.600 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.601 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.605 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.611 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.617 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.618 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.623 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-01-21T07:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.625 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.626 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-01-21T07:37:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.629 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.630 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.631 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.632 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.633 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.634 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.635 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.636 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.637 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.638 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.639 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.640 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.641 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.642 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.643 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.644 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.645 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.646 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.647 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.648 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.649 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.650 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.651 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.652 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.653 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.654 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.655 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.657 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.658 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.661 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.662 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.663 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.664 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.665 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.666 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.667 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.668 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.671 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.672 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.673 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.674 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.675 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.681 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.685 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.686 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-01-21T07:37:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-01-21T07:37:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.694 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.695 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.699 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.700 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.701 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.702 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.703 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.721 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.723 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.724 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.725 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.739 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.743 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.744 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.745 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.747 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.748 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-01-21T07:37:00.749 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-01-21T07:37:00.750 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-01-21T07:37:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:00.753 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:0", 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2682426603 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:0", 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1525539124 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:00.754 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:0", 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3112152988 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:00.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:00 smithi080 bash[13909]: audit 2024-01-21T07:37:00.086852+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.80:0/1069738117' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-01-21T07:37:00.756 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-01-21T07:37:00.757 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2024-01-21T07:37:00.757 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-01-21T07:37:00.757 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-01-21T07:37:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:03.729 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2024-01-21T07:37:03.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-01-21T07:37:03.730 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:03.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: cluster 2024-01-21T07:37:02.648048+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:37:03.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: cluster 2024-01-21T07:37:02.649026+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2024-01-21T07:37:03.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: cluster 2024-01-21T07:37:02.652439+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-01-21T07:37:03.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: cluster 2024-01-21T07:37:02.703203+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0543233s) 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.707363+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.708871+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.709222+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.709503+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.710385+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.711782+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.712485+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: cluster 2024-01-21T07:37:02.716081+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:02.755978+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-21T07:37:03.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:03 smithi080 bash[13909]: audit 2024-01-21T07:37:03.642820+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-21T07:37:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2024-01-21T07:37:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2024-01-21T07:37:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2024-01-21T07:37:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:04 smithi080 bash[13909]: cluster 2024-01-21T07:37:03.711927+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.06304s) 2024-01-21T07:37:05.993 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Generating ssh key... 2024-01-21T07:37:05.993 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2024-01-21T07:37:05.993 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2024-01-21T07:37:06.024 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:05 smithi080 bash[13909]: cluster 2024-01-21T07:37:04.715868+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-01-21T07:37:06.025 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:05 smithi080 bash[13909]: audit 2024-01-21T07:37:05.394058+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2024-01-21T07:37:06.025 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:05 smithi080 bash[13909]: audit 2024-01-21T07:37:05.396812+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2024-01-21T07:37:07.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:06 smithi080 bash[13909]: audit 2024-01-21T07:37:05.390785+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: Generating public/private rsa key pair. 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: Your identification has been saved in /tmp/tmpf94sviiv/key. 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: Your public key has been saved in /tmp/tmpf94sviiv/key.pub. 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: The key fingerprint is: 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: SHA256:PpzuZv+ePHQlfyRBPBQGAoo7KJu28kw45dGRlzR3W60 ceph-b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: The key's randomart image is: 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: +---[RSA 3072]----+ 2024-01-21T07:37:07.721 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: | o o.o o*=. | 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: | + = . + .= | 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: | + + . . o | 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: | o + E o o| 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: |. + + S * | 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: | B . . o . . . o| 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: |=.o = . . .| 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: |o+. .o. ... | 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: |.oo +o..o=. | 2024-01-21T07:37:07.722 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[14168]: +----[SHA256]-----+ 2024-01-21T07:37:07.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[13909]: audit 2024-01-21T07:37:07.145549+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:37:07.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[13909]: cephadm 2024-01-21T07:37:07.145981+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2024-01-21T07:37:07.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[13909]: audit 2024-01-21T07:37:07.309499+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAzgJc8k7V7egUNH8P+Ikmnk7JJvpJz1CE6Uqe+wE6GWF8BHEKrhWz\nMlJkrWOTGd6F/1JcmIQ61FVvSPfg7jscTEDvnnz4jRVHgK96IYlRgCFa1qHPb0NJ8H2cn0\nuj1EXgatPjzAdgOLx+a222UtQ2lzLTRjxepdvLCdSE6X5FZVyunaduAoU4EopjpvBJYBLe\nob1XxfZcQiRO1XL+xy34VP2s6F59usEhYElPrGaN2pBnkI2i0vCPeZUB2E8xTrad69wSEV\nIlqbhTKxFxN4Mr03ejE9TF8Rkw63OIvfHY7lHWuDx9ezn1fFLVe8o8fDDjVe5Sp2INK44a\nz2ObcIeQ1cYQosTs/fkLN2xlyd0//Yb5GWVnXHf1IXULkUfAHQNJTIJsVj2xP5805SiQuv\njO97F+DtLcuLxFfz0SD6m9bp8DupR1pVhJnQeQTh8EHAJMXgTM+Liqh84NoU0kV26Q/dv6\nAIqRix0boJ2A3MfaLar22hfyOs4HWarST0nGAoPJAAAFoB7mNGke5jRpAAAAB3NzaC1yc2\nEAAAGBAM4CXPJO1e3oFDR/D/iJJp5OySb6Sc9QhOlKnvsBOhlhfARxCq4VszJSZK1jkxne\nhf9SXJiEOtRVb0j34O47HExA7558+I0VR4CveiGJUYAhWtahz29DSfB9nJ9Lo9RF4GrT48\nwHYDi8fmtttlLUNpcy00Y8XqXbywnUhOl+RWVcrp2nbgKFOBKKY6bwSWAS3qG9V8X2XEIk\nTtVy/sct+FT9rOhefbrBIWBJT6xmjdqQZ5CNotLwj3mVAdhPMU62nevcEhFSJam4UysRcT\neDK9N3oxPUxfEZMOtziL3x2O5R1rg8fXs59XxS1XvKPHww41XuUqdiDSuOGs9jm3CHkNXG\nEKLE7P35CzdsZcndP/2G+RllZ1x39SF1C5FHwB0DSUyCbFY9sT+fNOUokLr4zvexfg7S3L\ni8RX89Eg+pvW6fA7qUdaVYSZ0HkE4fBBwCTF4EzPi4qofODaFNJFdukP3b+gCKkYsdG6Cd\ngNzH2i2q9toX8jrOB1mq0k9JxgKDyQAAAAMBAAEAAAGAYQyn8NbG3W8Jpbl+Mp2Z/dYr2R\nrsDqhmFOk8gA8R6ccM/6KpX12Fr9005KIWOIemJKQOTyNr+3/MD1oHMvPR3vJwb/97sCso\nJi2EoavpIy2Td61+5XGTsaHbWQfvRB8vG+R6WjHXWKMkA0QKMncayJv/AAWMqSIkQptFii\nIcWyYQdODdaH6N7d4YGBr21jXNf/CNGwt2ZwpnwRKNiBPV+2QOQuHQ5Vv6dzvSNuuRRDfn\nMignXqxJSwOxfM/B8M0CO0FVXf/S9epUwskXEUFQROk1DwbG0v9GQFnSVxBRGu+GLIuIiO\ngXN79tJQrNtZOm5JO2e6ok4T+liBvUQJfA0dxBxjFJy94fDvo4dKNhZnF5R6r/lqoz5H1v\nOKfR0Xs+JcutuNHG6zIcbmCc3YB4/2/IAKmxXy/pZLm62A6BWhPYqOG5Qe4uyPf1RP590X\n+WfdLayHUJhUSYtEn/sIOfywSnxiJdwpwBdb2cneIYCezMBhe18QGqlQLPFNt2WPIBAAAA\nwQDhBC1+OD6gCdr9p6SyglcPYYfA3NvCvQkHKEySw5o12q+6dwark+vVNAX5EdZGZJlG0T\nxjLnNicd6g9b9B/nz/8m2aAlkkiEsTEE5DUKHowPtSUXLft70Us8yRc4IFnBXO1n/qR1FR\nNo+PmTbMpj+PQN2LAeYaywxrvNtn1Q2TEkSf3wqUI/pLKO25Hby0HCTbjmytpSEAmwNGsC\n3VRm0j9dOY8IEWIiwCdHAQRhrVRBUevhNJavFMvlOO4nH+11MAAADBAPvT0F3hWnnY25R1\nGv7Qgv6ccA+rUqp4FScBA40YVbL8yUdzrG313RqKQNZ/euW3v3JRCZIOizgkFukXW1Ir0y\nZXcwqiIHRIio4CUZ6cvO/eCfDTPyDmYxZ/+12fCa5EnXnBdxgeL3vo4brPzALFSXBpScog\nHY+9ayUrBjKixU+uvz1iCN2v1x/PNBR79HToSHM8xWU0Ucc+6J4cTlSFMtYWjexZaHV/5f\nBZopJBL9oaz019bKtBx3nXtCr9XmVFqQAAAMEA0WwzT9z6CaMdMuUoBFLtPJcwwksh9/1J\nNZifnhz02gxKlV7Bhqb7WHVOrQU3GHXR0LiBwSBcB4JNu0TVqlcE/2fRwylQ/13s7TJ+1/\nzI0l3UZlefmo+TadqU74Z2tTdNiYn0U5HaPwTRXK+KLcA2T0XjGtgK9MeoetjJdvYCWRqI\naL8NWDRoA/BJR2L+Agi4AKkUZqj2m7nlrDAOhhfQ0z2+6DYabt5dqC4XV7h7oIU1tEYLf/\n7pVfiHiGzhw+EhAAAAKWNlcGgtYjg2NDE1ZDItYjgyZi0xMWVlLTk1YjAtODc3NzRmNjlh\nNzE1AQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:37:07.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[13909]: audit 2024-01-21T07:37:07.311561+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAzgJc8k7V7egUNH8P+Ikmnk7JJvpJz1CE6Uqe+wE6GWF8BHEKrhWz\nMlJkrWOTGd6F/1JcmIQ61FVvSPfg7jscTEDvnnz4jRVHgK96IYlRgCFa1qHPb0NJ8H2cn0\nuj1EXgatPjzAdgOLx+a222UtQ2lzLTRjxepdvLCdSE6X5FZVyunaduAoU4EopjpvBJYBLe\nob1XxfZcQiRO1XL+xy34VP2s6F59usEhYElPrGaN2pBnkI2i0vCPeZUB2E8xTrad69wSEV\nIlqbhTKxFxN4Mr03ejE9TF8Rkw63OIvfHY7lHWuDx9ezn1fFLVe8o8fDDjVe5Sp2INK44a\nz2ObcIeQ1cYQosTs/fkLN2xlyd0//Yb5GWVnXHf1IXULkUfAHQNJTIJsVj2xP5805SiQuv\njO97F+DtLcuLxFfz0SD6m9bp8DupR1pVhJnQeQTh8EHAJMXgTM+Liqh84NoU0kV26Q/dv6\nAIqRix0boJ2A3MfaLar22hfyOs4HWarST0nGAoPJAAAFoB7mNGke5jRpAAAAB3NzaC1yc2\nEAAAGBAM4CXPJO1e3oFDR/D/iJJp5OySb6Sc9QhOlKnvsBOhlhfARxCq4VszJSZK1jkxne\nhf9SXJiEOtRVb0j34O47HExA7558+I0VR4CveiGJUYAhWtahz29DSfB9nJ9Lo9RF4GrT48\nwHYDi8fmtttlLUNpcy00Y8XqXbywnUhOl+RWVcrp2nbgKFOBKKY6bwSWAS3qG9V8X2XEIk\nTtVy/sct+FT9rOhefbrBIWBJT6xmjdqQZ5CNotLwj3mVAdhPMU62nevcEhFSJam4UysRcT\neDK9N3oxPUxfEZMOtziL3x2O5R1rg8fXs59XxS1XvKPHww41XuUqdiDSuOGs9jm3CHkNXG\nEKLE7P35CzdsZcndP/2G+RllZ1x39SF1C5FHwB0DSUyCbFY9sT+fNOUokLr4zvexfg7S3L\ni8RX89Eg+pvW6fA7qUdaVYSZ0HkE4fBBwCTF4EzPi4qofODaFNJFdukP3b+gCKkYsdG6Cd\ngNzH2i2q9toX8jrOB1mq0k9JxgKDyQAAAAMBAAEAAAGAYQyn8NbG3W8Jpbl+Mp2Z/dYr2R\nrsDqhmFOk8gA8R6ccM/6KpX12Fr9005KIWOIemJKQOTyNr+3/MD1oHMvPR3vJwb/97sCso\nJi2EoavpIy2Td61+5XGTsaHbWQfvRB8vG+R6WjHXWKMkA0QKMncayJv/AAWMqSIkQptFii\nIcWyYQdODdaH6N7d4YGBr21jXNf/CNGwt2ZwpnwRKNiBPV+2QOQuHQ5Vv6dzvSNuuRRDfn\nMignXqxJSwOxfM/B8M0CO0FVXf/S9epUwskXEUFQROk1DwbG0v9GQFnSVxBRGu+GLIuIiO\ngXN79tJQrNtZOm5JO2e6ok4T+liBvUQJfA0dxBxjFJy94fDvo4dKNhZnF5R6r/lqoz5H1v\nOKfR0Xs+JcutuNHG6zIcbmCc3YB4/2/IAKmxXy/pZLm62A6BWhPYqOG5Qe4uyPf1RP590X\n+WfdLayHUJhUSYtEn/sIOfywSnxiJdwpwBdb2cneIYCezMBhe18QGqlQLPFNt2WPIBAAAA\nwQDhBC1+OD6gCdr9p6SyglcPYYfA3NvCvQkHKEySw5o12q+6dwark+vVNAX5EdZGZJlG0T\nxjLnNicd6g9b9B/nz/8m2aAlkkiEsTEE5DUKHowPtSUXLft70Us8yRc4IFnBXO1n/qR1FR\nNo+PmTbMpj+PQN2LAeYaywxrvNtn1Q2TEkSf3wqUI/pLKO25Hby0HCTbjmytpSEAmwNGsC\n3VRm0j9dOY8IEWIiwCdHAQRhrVRBUevhNJavFMvlOO4nH+11MAAADBAPvT0F3hWnnY25R1\nGv7Qgv6ccA+rUqp4FScBA40YVbL8yUdzrG313RqKQNZ/euW3v3JRCZIOizgkFukXW1Ir0y\nZXcwqiIHRIio4CUZ6cvO/eCfDTPyDmYxZ/+12fCa5EnXnBdxgeL3vo4brPzALFSXBpScog\nHY+9ayUrBjKixU+uvz1iCN2v1x/PNBR79HToSHM8xWU0Ucc+6J4cTlSFMtYWjexZaHV/5f\nBZopJBL9oaz019bKtBx3nXtCr9XmVFqQAAAMEA0WwzT9z6CaMdMuUoBFLtPJcwwksh9/1J\nNZifnhz02gxKlV7Bhqb7WHVOrQU3GHXR0LiBwSBcB4JNu0TVqlcE/2fRwylQ/13s7TJ+1/\nzI0l3UZlefmo+TadqU74Z2tTdNiYn0U5HaPwTRXK+KLcA2T0XjGtgK9MeoetjJdvYCWRqI\naL8NWDRoA/BJR2L+Agi4AKkUZqj2m7nlrDAOhhfQ0z2+6DYabt5dqC4XV7h7oIU1tEYLf/\n7pVfiHiGzhw+EhAAAAKWNlcGgtYjg2NDE1ZDItYjgyZi0xMWVlLTk1YjAtODc3NzRmNjlh\nNzE1AQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2024-01-21T07:37:07.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[13909]: audit 2024-01-21T07:37:07.312196+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715\n"}]: dispatch 2024-01-21T07:37:07.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:07 smithi080 bash[13909]: audit 2024-01-21T07:37:07.315771+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715\n"}]': finished 2024-01-21T07:37:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2024-01-21T07:37:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2024-01-21T07:37:09.118 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:37:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2024-01-21T07:37:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2024-01-21T07:37:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Adding host smithi080... 2024-01-21T07:37:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'smithi080'] 2024-01-21T07:37:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add smithi080 2024-01-21T07:37:10.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:09 smithi080 bash[13909]: audit 2024-01-21T07:37:09.115558+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:37:11.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:10 smithi080 bash[14168]: Warning: Permanently added 'smithi080,172.21.15.80' (ECDSA) to the list of known hosts. 2024-01-21T07:37:11.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:11 smithi080 bash[13909]: audit 2024-01-21T07:37:10.935955+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:37:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi080' 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:11.576478+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:11.580781+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: cephadm 2024-01-21T07:37:11.581556+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host smithi080 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:11.862499+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:11.866726+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:11.867812+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:12.331710+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:12.327453\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:12.331007\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:37:12.331113\", \"networks\": {}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:12.336111+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:12.327453\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:12.331007\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:37:12.331113\", \"networks\": {}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:37:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:12 smithi080 bash[13909]: audit 2024-01-21T07:37:12.337106+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.15.80:0/771128979' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:37:12.953 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Enabling the dashboard module... 2024-01-21T07:37:12.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2024-01-21T07:37:12.953 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2024-01-21T07:37:15.019 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:14 smithi080 bash[13909]: audit 2024-01-21T07:37:14.536316+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.15.80:0/2950027651' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-01-21T07:37:15.019 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:14 smithi080 bash[14168]: ignoring --setuser ceph since I am not root 2024-01-21T07:37:15.019 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:14 smithi080 bash[14168]: ignoring --setgroup ceph since I am not root 2024-01-21T07:37:15.598 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-01-21T07:37:15.599 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-01-21T07:37:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:15 smithi080 bash[13909]: audit 2024-01-21T07:37:14.657927+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.80:0/2950027651' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-01-21T07:37:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:15 smithi080 bash[13909]: cluster 2024-01-21T07:37:14.658044+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 12s) 2024-01-21T07:37:17.217 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.217 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2024-01-21T07:37:17.217 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2024-01-21T07:37:17.217 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:6800", 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1935270641 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:6801", 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1935270641 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.80:6801/1935270641", 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-01-21T07:37:02.648863+0000", 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.225 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-01-21T07:37:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-01-21T07:37:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-01-21T07:37:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-01-21T07:37:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-01-21T07:37:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.253 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:17.254 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-01-21T07:37:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-01-21T07:37:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-01-21T07:37:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.276 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.277 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.278 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-01-21T07:37:17.279 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-01-21T07:37:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-01-21T07:37:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-01-21T07:37:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-21T07:37:17.291 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-21T07:37:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.297 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.299 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.300 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.301 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.302 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.303 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-01-21T07:37:17.304 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.315 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.317 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.318 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.319 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-01-21T07:37:17.320 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.321 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.322 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.323 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.324 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-01-21T07:37:17.325 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.326 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-01-21T07:37:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.333 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.334 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.335 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-01-21T07:37:17.336 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.337 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.338 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.339 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.340 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.341 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.342 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.343 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.344 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.345 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.346 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-01-21T07:37:17.347 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.353 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.354 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.355 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.356 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-01-21T07:37:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.368 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.369 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.370 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-01-21T07:37:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.379 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.381 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.382 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.383 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.384 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.385 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.386 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.388 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-01-21T07:37:17.390 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.391 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.394 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.395 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.396 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.397 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.398 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.399 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.400 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.401 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.402 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.403 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.404 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.405 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.406 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.407 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.409 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-01-21T07:37:17.415 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-01-21T07:37:17.416 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.417 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.418 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.419 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.420 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.421 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.422 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.423 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.424 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.425 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.426 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.427 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.428 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.431 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.435 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.437 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.440 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.441 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.442 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.443 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.444 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.445 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.446 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.447 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.448 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.449 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.450 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.451 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.452 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.453 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.454 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.460 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.462 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.463 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.464 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.465 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.466 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.467 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-21T07:37:17.468 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-01-21T07:37:17.469 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.470 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.471 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.472 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.473 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.475 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.476 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-01-21T07:37:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.479 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.480 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.482 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.483 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.484 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.485 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.486 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.487 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.488 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-01-21T07:37:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.492 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.497 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.498 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.500 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.501 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.502 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.503 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.504 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.505 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.506 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.507 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.508 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.509 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.510 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.511 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-01-21T07:37:17.512 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-01-21T07:37:17.513 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.514 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-01-21T07:37:17.515 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:17.516 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:0", 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2682865589 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:0", 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 876829809 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:17.517 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.80:0", 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 927839510 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.518 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:17.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:16 smithi080 bash[13909]: audit 2024-01-21T07:37:16.878695+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.15.80:0/1486808947' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-01-21T07:37:17.844 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-01-21T07:37:17.844 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2024-01-21T07:37:17.845 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-01-21T07:37:17.845 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-01-21T07:37:20.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:19 smithi080 bash[13909]: cluster 2024-01-21T07:37:18.988119+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:37:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:19 smithi080 bash[13909]: cluster 2024-01-21T07:37:18.988923+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2024-01-21T07:37:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:19 smithi080 bash[13909]: cluster 2024-01-21T07:37:18.991927+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-01-21T07:37:20.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:37:19 smithi080 bash[14168]: Warning: Permanently added 'smithi080,172.21.15.80' (ECDSA) to the list of known hosts. 2024-01-21T07:37:20.678 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-01-21T07:37:20.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2024-01-21T07:37:20.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-01-21T07:37:20.679 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: cluster 2024-01-21T07:37:19.657790+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.668948s) 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.661377+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.662834+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.663224+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.663565+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.664478+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.665928+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.666521+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:37:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.667129+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.667691+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.668260+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.668820+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: cluster 2024-01-21T07:37:19.672610+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:19.724417+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:20.630285+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-21T07:37:21.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:20 smithi080 bash[13909]: audit 2024-01-21T07:37:20.631289+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:37:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2024-01-21T07:37:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2024-01-21T07:37:21.329 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2024-01-21T07:37:22.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:21 smithi080 bash[13909]: cluster 2024-01-21T07:37:20.661345+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e11: y(active, since 1.67253s) 2024-01-21T07:37:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:21 smithi080 bash[13909]: audit 2024-01-21T07:37:21.337273+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:37:21.336632\", \"networks\": {}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:37:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:21 smithi080 bash[13909]: audit 2024-01-21T07:37:21.339284+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:37:21.336632\", \"networks\": {}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:37:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:21 smithi080 bash[13909]: audit 2024-01-21T07:37:21.340044+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:37:22.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:22 smithi080 bash[13909]: cluster 2024-01-21T07:37:21.672839+0000 mon.a (mon.0) 94 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-01-21T07:37:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2024-01-21T07:37:23.853 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Creating initial admin user... 2024-01-21T07:37:23.853 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 's0hgvnn3e0', 'administrator', '--force-password', '--pwd-update-required'] 2024-01-21T07:37:23.853 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin s0hgvnn3e0 administrator --force-password --pwd-update-required 2024-01-21T07:37:24.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:23 smithi080 bash[13909]: audit 2024-01-21T07:37:23.041241+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCED7Laz0Yi0zrikY0RRj8bEswDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTI0MDEyMTA3Mzcy\nM1oXDTM0MDExODA3MzcyM1owJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAxwolFOiS\ns8uH8nva9nGftak/drkD7olFBjJycoQRg9oARmmw8if0BxeEMB+Qm7VeZg1Qm0kn\n0lZrI3iUcXPfaBl1DIPiM+WvktWHZcWxoWCMMa3LVU3orW+VD8qS8HCj9IwSL1ms\nk9FwsMStwOLYiUlJ2A2p5tLUz5D6wxwzwsaXzNfyH5zc9uDOzPkpzeSNW9+JWHS2\nnzDO9AozM+mGmJZtyY0gt+21i/gBC1UBiPB9Jg/VCdQ+thLddQqgATiki8pMpGog\nKP02NSnOsLGAFmKnqpM6PgUQZ1dU9RHZgQMrOvu+vDdOcbfuDjN4EXIvGHDzP5Yn\nqN0dwu7gpx5LtwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCfqanW7nBSygB4jINf\nVDmyCh1Z8zx52dCF38rfXf0eVMeo1UGX8QGv2RsKTFIpaAPvyUjZD5/9LmPZbVFn\nJ2ssTKjcn6TlRBkIj3D+b6kKXCTANzCKgQGBw4wMV9tANT6dUzC2fCwr84CwYSQV\nG7Vf8FBwBFWYVibT5Gyw4l3itiyft3T7bxy/f/R/X9k4j28QHODm6Xb299KEZplV\nqPI6ClnMbbEZc/GvR+NRapjPNUILzcMLMljE7TeXYzzFz4DcKif92VxCnZWpxmyd\nIPQQGg4XJaF7HCAtn53hmD2MGqPBD/LRxwEF2/fme37aOUBNi23OoN8rmB5FInja\ncZrf\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:37:24.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:23 smithi080 bash[13909]: audit 2024-01-21T07:37:23.045027+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCED7Laz0Yi0zrikY0RRj8bEswDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTI0MDEyMTA3Mzcy\nM1oXDTM0MDExODA3MzcyM1owJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAxwolFOiS\ns8uH8nva9nGftak/drkD7olFBjJycoQRg9oARmmw8if0BxeEMB+Qm7VeZg1Qm0kn\n0lZrI3iUcXPfaBl1DIPiM+WvktWHZcWxoWCMMa3LVU3orW+VD8qS8HCj9IwSL1ms\nk9FwsMStwOLYiUlJ2A2p5tLUz5D6wxwzwsaXzNfyH5zc9uDOzPkpzeSNW9+JWHS2\nnzDO9AozM+mGmJZtyY0gt+21i/gBC1UBiPB9Jg/VCdQ+thLddQqgATiki8pMpGog\nKP02NSnOsLGAFmKnqpM6PgUQZ1dU9RHZgQMrOvu+vDdOcbfuDjN4EXIvGHDzP5Yn\nqN0dwu7gpx5LtwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCfqanW7nBSygB4jINf\nVDmyCh1Z8zx52dCF38rfXf0eVMeo1UGX8QGv2RsKTFIpaAPvyUjZD5/9LmPZbVFn\nJ2ssTKjcn6TlRBkIj3D+b6kKXCTANzCKgQGBw4wMV9tANT6dUzC2fCwr84CwYSQV\nG7Vf8FBwBFWYVibT5Gyw4l3itiyft3T7bxy/f/R/X9k4j28QHODm6Xb299KEZplV\nqPI6ClnMbbEZc/GvR+NRapjPNUILzcMLMljE7TeXYzzFz4DcKif92VxCnZWpxmyd\nIPQQGg4XJaF7HCAtn53hmD2MGqPBD/LRxwEF2/fme37aOUBNi23OoN8rmB5FInja\ncZrf\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:37:24.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:23 smithi080 bash[13909]: audit 2024-01-21T07:37:23.045715+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDHCiUU6JKzy4fy\ne9r2cZ+1qT92uQPuiUUGMnJyhBGD2gBGabDyJ/QHF4QwH5CbtV5mDVCbSSfSVmsj\neJRxc99oGXUMg+Iz5a+S1YdlxbGhYIwxrctVTeitb5UPypLwcKP0jBIvWayT0XCw\nxK3A4tiJSUnYDanm0tTPkPrDHDPCxpfM1/IfnNz24M7M+SnN5I1b34lYdLafMM70\nCjMz6YaYlm3JjSC37bWL+AELVQGI8H0mD9UJ1D62Et11CqABOKSLykykaiAo/TY1\nKc6wsYAWYqeqkzo+BRBnV1T1EdmBAys6+768N05xt+4OM3gRci8YcPM/lieo3R3C\n7uCnHku3AgMBAAECggEAbBFPBuYr2OD2JCspPMt+eoS1R4G258myJ2Y2i4S3ec5g\nfdqezyvwK/WRuQs6WcCEy4YJMPbsXyC6tRygBGV0dDH2QmBM7f6UcHXtOM243zTr\niYGiN+PAJILD/TnwxAl0i6+NpBXdRLjfpapz6JmCFjArntn0WLY6A6Tk8hCa7fIs\n0xqjfcra1/WPB6eDMGlhl7chkcFYnecRZq06ApkxQiMGV6cXgfmVjork0Fi14JeY\neMa/GLB099SsjbZJfAmIftNTtdtcI3GriTKnXA7Ccvyhde74wFkDh2NoUL0y4s5D\n64Zq68QhclebHTdEvb3PBBtp4sXzdnFNfoY0VGuMEQKBgQD+ZoojhsG+JCpqY5w7\nLSVpBF1JXxk+ZLV1shl9XmudsN9BKL/3zMZHGCXX2v/bqD3hbumF+/XideCBhadG\nq2IG3rL7NpJLbQ8bRbyUg2UjTOfQUXBuLDCPZEDS6ZK2GxpWb2pqIwZC1YUNyDp+\nQevplc7jU6CgBWjiz1L0hSFOvwKBgQDISoBSd9wWSrSsPyCxtLUGyyWpmo6C9fT9\nfK+ENxGTq4+LOvB2OsgQs1+Z5TCmH66ByLIBGWW2Qif7YgLbCqnXTurEJoCgjAfl\nv2cB2owCER8fiIBFCOdKH2uMaTq4xr7ju3xVd7VQUE+zcFaBAjSWZ76LiQ0PqTuc\nRan1thY5CQKBgBpkaupanZjrSZc19ExTV7E4abEl84l8izLFok1WUVXPtqmc36WG\nkf9oKuzk5GxWXO0ZQ5LJ2+19iygExKDZQNcznV/gfnbivpF2v6SsqP5riRUcjcxw\nOy11GiCHaNgJocbb0i9mqMygOCiA4Eie8CmQiCEfWOehCAuXtKR3d0gjAoGBAJus\nnFR86MlCw27lmgnFRLbFCr7qbD4J4aNsWBdRng3C2M0EwIWEZp/kazf4VXmpQj+J\nuCD2loG0pdLTeRi7DwtUQVC4BF3EuRavT+a28P9iQ2iE9f2yT+LizPrTh1q6zv++\nZ4MeigSkh24WsIWRK0KD3CwkF8zGYpix5Mof/uHRAoGBAO3/wdcWI2Nou5LrVHR6\nsaylPixNBfPi/sRLq1STX4OhXV6LPxJmuDFKUtBifV7/Uly52AyQdXRiTQECE9Ej\nsZVmtWnoMMv4aUCrqYJLm5nj4EpRgRAfBpsL2wo+11tMqm+L+UsWfivkiIkQtuv/\nLKQCLgm3JmhaK934wksNH2E/\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:37:24.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:23 smithi080 bash[13909]: audit 2024-01-21T07:37:23.049106+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDHCiUU6JKzy4fy\ne9r2cZ+1qT92uQPuiUUGMnJyhBGD2gBGabDyJ/QHF4QwH5CbtV5mDVCbSSfSVmsj\neJRxc99oGXUMg+Iz5a+S1YdlxbGhYIwxrctVTeitb5UPypLwcKP0jBIvWayT0XCw\nxK3A4tiJSUnYDanm0tTPkPrDHDPCxpfM1/IfnNz24M7M+SnN5I1b34lYdLafMM70\nCjMz6YaYlm3JjSC37bWL+AELVQGI8H0mD9UJ1D62Et11CqABOKSLykykaiAo/TY1\nKc6wsYAWYqeqkzo+BRBnV1T1EdmBAys6+768N05xt+4OM3gRci8YcPM/lieo3R3C\n7uCnHku3AgMBAAECggEAbBFPBuYr2OD2JCspPMt+eoS1R4G258myJ2Y2i4S3ec5g\nfdqezyvwK/WRuQs6WcCEy4YJMPbsXyC6tRygBGV0dDH2QmBM7f6UcHXtOM243zTr\niYGiN+PAJILD/TnwxAl0i6+NpBXdRLjfpapz6JmCFjArntn0WLY6A6Tk8hCa7fIs\n0xqjfcra1/WPB6eDMGlhl7chkcFYnecRZq06ApkxQiMGV6cXgfmVjork0Fi14JeY\neMa/GLB099SsjbZJfAmIftNTtdtcI3GriTKnXA7Ccvyhde74wFkDh2NoUL0y4s5D\n64Zq68QhclebHTdEvb3PBBtp4sXzdnFNfoY0VGuMEQKBgQD+ZoojhsG+JCpqY5w7\nLSVpBF1JXxk+ZLV1shl9XmudsN9BKL/3zMZHGCXX2v/bqD3hbumF+/XideCBhadG\nq2IG3rL7NpJLbQ8bRbyUg2UjTOfQUXBuLDCPZEDS6ZK2GxpWb2pqIwZC1YUNyDp+\nQevplc7jU6CgBWjiz1L0hSFOvwKBgQDISoBSd9wWSrSsPyCxtLUGyyWpmo6C9fT9\nfK+ENxGTq4+LOvB2OsgQs1+Z5TCmH66ByLIBGWW2Qif7YgLbCqnXTurEJoCgjAfl\nv2cB2owCER8fiIBFCOdKH2uMaTq4xr7ju3xVd7VQUE+zcFaBAjSWZ76LiQ0PqTuc\nRan1thY5CQKBgBpkaupanZjrSZc19ExTV7E4abEl84l8izLFok1WUVXPtqmc36WG\nkf9oKuzk5GxWXO0ZQ5LJ2+19iygExKDZQNcznV/gfnbivpF2v6SsqP5riRUcjcxw\nOy11GiCHaNgJocbb0i9mqMygOCiA4Eie8CmQiCEfWOehCAuXtKR3d0gjAoGBAJus\nnFR86MlCw27lmgnFRLbFCr7qbD4J4aNsWBdRng3C2M0EwIWEZp/kazf4VXmpQj+J\nuCD2loG0pdLTeRi7DwtUQVC4BF3EuRavT+a28P9iQ2iE9f2yT+LizPrTh1q6zv++\nZ4MeigSkh24WsIWRK0KD3CwkF8zGYpix5Mof/uHRAoGBAO3/wdcWI2Nou5LrVHR6\nsaylPixNBfPi/sRLq1STX4OhXV6LPxJmuDFKUtBifV7/Uly52AyQdXRiTQECE9Ej\nsZVmtWnoMMv4aUCrqYJLm5nj4EpRgRAfBpsL2wo+11tMqm+L+UsWfivkiIkQtuv/\nLKQCLgm3JmhaK934wksNH2E/\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:37:25.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:24 smithi080 bash[13909]: audit 2024-01-21T07:37:22.963076+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:37:25.527 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$SorQB9sBatwn3S2H6NVJX.qJzrU8SWm2FVEwA4qibKkxRJMt8/QOG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1705822645, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-01-21T07:37:25.884 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:25 smithi080 bash[13909]: audit 2024-01-21T07:37:25.521640+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$SorQB9sBatwn3S2H6NVJX.qJzrU8SWm2FVEwA4qibKkxRJMt8/QOG\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1705822645, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2024-01-21T07:37:25.884 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:25 smithi080 bash[13909]: audit 2024-01-21T07:37:25.524242+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$SorQB9sBatwn3S2H6NVJX.qJzrU8SWm2FVEwA4qibKkxRJMt8/QOG\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1705822645, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2024-01-21T07:37:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Fetching dashboard port number... 2024-01-21T07:37:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi080', '-v', '/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2024-01-21T07:37:26.309 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi080 -v /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpx59fkaul:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpoddjl_k6:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2024-01-21T07:37:27.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:26 smithi080 bash[13909]: audit 2024-01-21T07:37:25.282119+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "s0hgvnn3e0", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:37:27.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:26 smithi080 bash[13909]: cluster 2024-01-21T07:37:25.677613+0000 mon.a (mon.0) 101 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-01-21T07:37:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2024-01-21T07:37:27.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:27 smithi080 bash[13909]: audit 2024-01-21T07:37:26.989985+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:37:27.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:27 smithi080 bash[13909]: audit 2024-01-21T07:37:27.211911+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:37:21.336632\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:37:27.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:27 smithi080 bash[13909]: audit 2024-01-21T07:37:27.215955+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:37:21.336632\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr: URL: https://smithi080.front.sepia.ceph.com:8443/ 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr: User: admin 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr: Password: s0hgvnn3e0 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:You can access the Ceph CLI with: 2024-01-21T07:37:28.479 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: ceph telemetry on 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr:For more information see: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:37:28.480 INFO:teuthology.orchestra.run.smithi080.stderr:INFO:cephadm:Bootstrap complete. 2024-01-21T07:37:28.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Releasing lock 140594175682736 on /run/cephadm/b86415d2-b82f-11ee-95b0-87774f69a715.lock 2024-01-21T07:37:28.481 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG:cephadm:Lock 140594175682736 released on /run/cephadm/b86415d2-b82f-11ee-95b0-87774f69a715.lock 2024-01-21T07:37:28.507 INFO:tasks.cephadm:Fetching config... 2024-01-21T07:37:28.507 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:37:28.507 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-01-21T07:37:28.513 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-01-21T07:37:28.513 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:37:28.514 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-01-21T07:37:28.522 INFO:tasks.cephadm:Fetching mon keyring... 2024-01-21T07:37:28.522 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:37:28.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/mon.a/keyring of=/dev/stdout 2024-01-21T07:37:28.536 INFO:tasks.cephadm:Fetching pub ssh key... 2024-01-21T07:37:28.536 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:37:28.536 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-01-21T07:37:28.543 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-01-21T07:37:28.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-21T07:37:28.570 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:37:28.582 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-21T07:37:28.606 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOAlzyTtXt6BQ0fw/4iSaeTskm+knPUITpSp77AToZYXwEcQquFbMyUmStY5MZ3oX/UlyYhDrUVW9I9+DuOxxMQO+efPiNFUeAr3ohiVGAIVrWoc9vQ0nwfZyfS6PUReBq0+PMB2A4vH5rbbZS1DaXMtNGPF6l28sJ1ITpfkVlXK6dp24ChTgSimOm8ElgEt6hvVfF9lxCJE7Vcv7HLfhU/azoXn26wSFgSU+sZo3akGeQjaLS8I95lQHYTzFOtp3r3BIRUiWpuFMrEXE3gyvTd6MT1MXxGTDrc4i98djuUda4PH17OfV8UtV7yjx8MONV7lKnYg0rjhrPY5twh5DVxhCixOz9+Qs3bGXJ3T/9hvkZZWdcd/UhdQuRR8AdA0lMgmxWPbE/nzTlKJC6+M73sX4O0ty4vEV/PRIPqb1unwO6lHWlWEmdB5BOHwQcAkxeBMz4uKqHzg2hTSRXbpD92/oAipGLHRugnYDcx9otqvbaF/I6zgdZqtJPScYCg8k= ceph-b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:37:28.617 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-01-21T07:37:28.617 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:37:28.617 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-01-21T07:37:28.623 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:37:28.623 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-21T07:37:28.670 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-01-21T07:37:28.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch host add smithi195 2024-01-21T07:37:28.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:28 smithi080 bash[13909]: audit 2024-01-21T07:37:27.765115+0000 mon.a (mon.0) 105 : audit [DBG] from='client.? 172.21.15.80:0/3877009591' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-01-21T07:37:41.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:40 smithi080 bash[13909]: cluster 2024-01-21T07:37:39.664749+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:43.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:42 smithi080 bash[13909]: cluster 2024-01-21T07:37:41.665316+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:45.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:44 smithi080 bash[13909]: cluster 2024-01-21T07:37:43.665803+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:45 smithi080 bash[13909]: cluster 2024-01-21T07:37:45.666228+0000 mgr.y (mgr.14140) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:47 smithi080 bash[13909]: cluster 2024-01-21T07:37:47.666672+0000 mgr.y (mgr.14140) 7 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:50.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:49 smithi080 bash[13909]: cluster 2024-01-21T07:37:49.667047+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:51 smithi080 bash[13909]: cluster 2024-01-21T07:37:51.667489+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:55.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:54 smithi080 bash[13909]: cluster 2024-01-21T07:37:53.667892+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:55 smithi080 bash[13909]: cluster 2024-01-21T07:37:55.668271+0000 mgr.y (mgr.14140) 11 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:37:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:57 smithi080 bash[13909]: cluster 2024-01-21T07:37:57.668728+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:37:59 smithi080 bash[13909]: cluster 2024-01-21T07:37:59.669249+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:02.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:01 smithi080 bash[13909]: cluster 2024-01-21T07:38:01.669765+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:04.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:38:03 smithi080 bash[14168]: Warning: Permanently added 'smithi195,172.21.15.195' (ECDSA) to the list of known hosts. 2024-01-21T07:38:04.846 INFO:teuthology.orchestra.run.smithi195.stdout:Added host 'smithi195' 2024-01-21T07:38:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:04 smithi080 bash[13909]: cluster 2024-01-21T07:38:03.670347+0000 mgr.y (mgr.14140) 15 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:04 smithi080 bash[13909]: audit 2024-01-21T07:38:04.479354+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:38:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:04 smithi080 bash[13909]: audit 2024-01-21T07:38:04.483515+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:38:05.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch host ls --format=json 2024-01-21T07:38:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:03.840253+0000 mgr.y (mgr.14140) 16 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: cephadm 2024-01-21T07:38:04.484463+0000 mgr.y (mgr.14140) 17 : cephadm [INF] Added host smithi195 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:04.780138+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:04.783727+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:04.785034+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:05.016267+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:38:05.015719\", \"networks\": {}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:05.019146+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:38:05.015719\", \"networks\": {}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:05 smithi080 bash[13909]: audit 2024-01-21T07:38:05.020142+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:38:07.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:06 smithi080 bash[13909]: cluster 2024-01-21T07:38:05.670840+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:09.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:08 smithi080 bash[13909]: cluster 2024-01-21T07:38:07.671283+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:09.460 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-21T07:38:09.460 INFO:teuthology.orchestra.run.smithi195.stdout:[{"addr": "smithi080", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "smithi195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-01-21T07:38:10.068 INFO:tasks.cephadm:Setting crush tunables to default 2024-01-21T07:38:10.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd crush tunables default 2024-01-21T07:38:10.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:10 smithi080 bash[13909]: audit 2024-01-21T07:38:09.456159+0000 mgr.y (mgr.14140) 20 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:38:10.978 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:10 smithi080 bash[13909]: cluster 2024-01-21T07:38:09.671724+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:11.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:11 smithi080 bash[13909]: audit 2024-01-21T07:38:10.736156+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:11.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:11 smithi080 bash[13909]: audit 2024-01-21T07:38:10.966759+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:38:05.015719\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:11.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:11 smithi080 bash[13909]: audit 2024-01-21T07:38:10.971385+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-01-21T07:38:05.015719\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-01-21T07:38:13.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:12 smithi080 bash[13909]: cluster 2024-01-21T07:38:11.672189+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:13.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:12 smithi080 bash[13909]: audit 2024-01-21T07:38:12.373223+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.15.80:0/1554862340' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-21T07:38:13.682 INFO:tasks.cephadm:Adding mon.c on smithi080 2024-01-21T07:38:13.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add mon 'smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c' 2024-01-21T07:38:14.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:13 smithi080 bash[13909]: audit 2024-01-21T07:38:12.974454+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.15.80:0/1554862340' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-21T07:38:14.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:13 smithi080 bash[13909]: cluster 2024-01-21T07:38:12.974598+0000 mon.a (mon.0) 119 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-01-21T07:38:14.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:13 smithi080 bash[13909]: cluster 2024-01-21T07:38:13.672657+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:15 smithi080 bash[13909]: cluster 2024-01-21T07:38:15.673048+0000 mgr.y (mgr.14140) 24 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:16 smithi080 bash[13909]: audit 2024-01-21T07:38:16.338120+0000 mgr.y (mgr.14140) 25 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:16 smithi080 bash[13909]: audit 2024-01-21T07:38:16.340302+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:38:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:16 smithi080 bash[13909]: audit 2024-01-21T07:38:16.341789+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:16 smithi080 bash[13909]: cephadm 2024-01-21T07:38:16.342873+0000 mgr.y (mgr.14140) 26 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-01-21T07:38:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:16 smithi080 bash[13909]: audit 2024-01-21T07:38:16.343413+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-01-21T07:38:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:17 smithi080 bash[13909]: cluster 2024-01-21T07:38:17.673492+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:20.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:19 smithi080 bash[13909]: cluster 2024-01-21T07:38:19.674069+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:19 smithi080 bash[13909]: cluster 2024-01-21T07:38:19.725003+0000 mon.a (mon.0) 123 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-01-21T07:38:20.348 INFO:teuthology.orchestra.run.smithi080.stdout:Deployed mon.c on host 'smithi080' 2024-01-21T07:38:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:20 smithi080 bash[13909]: audit 2024-01-21T07:38:19.916750+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:20 smithi080 bash[13909]: audit 2024-01-21T07:38:19.917216+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:21.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:20 smithi080 bash[13909]: audit 2024-01-21T07:38:19.925016+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:21.326 DEBUG:teuthology.orchestra.run.smithi080:mon.c> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.c.service 2024-01-21T07:38:21.328 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-01-21T07:38:21.328 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph mon dump -f json 2024-01-21T07:38:21.534 INFO:journalctl@ceph.mon.c.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:38:21.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 load: jerasure load: lrc load: isa 2024-01-21T07:38:21.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:38:21.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:38:21.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:38:21.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:38:21.535 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 1 rocksdb: do_open column families: [default] 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: RocksDB version: 6.1.2 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Compile date Mar 23 2020 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: DB SUMMARY 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: CURRENT file: CURRENT 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: IDENTITY file: IDENTITY 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 489 ; 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:38:21.536 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.create_if_missing: 0 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.env: 0x5653964631a0 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.info_log: 0x5653988ac9a0 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:38:21.537 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:38:21.538 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.db_log_dir: 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.write_buffer_manager: 0x565399446b10 2024-01-21T07:38:21.540 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.row_cache: None 2024-01-21T07:38:21.541 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.wal_filter: None 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:38:21.542 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Compression algorithms supported: 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kZSTD supported: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:38:21.543 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.merge_operator: 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5653987cc138) 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: cache_index_and_filter_blocks: 1 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: cache_index_and_filter_blocks_with_high_priority: 1 2024-01-21T07:38:21.544 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: pin_top_level_index_and_filter: 1 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: index_type: 0 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: data_block_index_type: 0 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: hash_index_allow_collision: 1 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: checksum: 1 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: no_block_cache: 0 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_cache: 0x565398802610 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_cache_name: BinnedLRUCache 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_cache_options: 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: capacity : 536870912 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: num_shard_bits : 4 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: strict_capacity_limit : 0 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: high_pri_pool_ratio: 0.000 2024-01-21T07:38:21.545 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_cache_compressed: (nil) 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: persistent_cache: (nil) 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_size: 4096 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_size_deviation: 10 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_restart_interval: 16 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: index_block_restart_interval: 1 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: metadata_block_size: 4096 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: partition_filters: 0 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: use_delta_encoding: 1 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: whole_key_filtering: 1 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: verify_compression: 0 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: read_amp_bytes_per_bit: 0 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: format_version: 2 2024-01-21T07:38:21.546 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: enable_index_compression: 1 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: block_align: 0 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.num_levels: 7 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:38:21.547 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:38:21.548 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.337+0000 7f8a6722f6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:38:21.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:38:21.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: Options.ttl: 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822701343619, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-01-21T07:38:21.551 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2024-01-21T07:38:21.552 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822701344179, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1403, "table_properties": {"data_size": 501, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 379, "raw_average_value_size": 75, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-01-21T07:38:21.552 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2024-01-21T07:38:21.552 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822701344655, "job": 1, "event": "recovery_finished"} 2024-01-21T07:38:21.552 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 4 rocksdb: DB pointer 0x56539889e400 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a4e37c700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a4e37c700 4 rocksdb: [db/db_impl.cc:778] 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** DB Stats ** 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** Compaction Stats [default] ** 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.553 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** Compaction Stats [default] ** 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:38:21.554 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Cumulative compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Interval compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** Compaction Stats [default] ** 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** Compaction Stats [default] ** 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:21.555 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.000 0 0 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Cumulative compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-01-21T07:38:21.556 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.341+0000 7f8a6722f6c0 0 using public_addrv [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.345+0000 7f8a6722f6c0 0 starting mon.c rank -1 at public addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] at bind addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.345+0000 7f8a6722f6c0 1 mon.c@-1(???) e0 preinit fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 0 mon.c@-1(synchronizing).mds e1 new map 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: e1 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: enable_multiple, ever_enabled_multiple: 0,0 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: legacy client fscid: -1 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: No filesystems configured 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-21T07:38:21.557 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: audit 2024-01-21T07:38:19.916750+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: audit 2024-01-21T07:38:19.917216+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:21.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: audit 2024-01-21T07:38:19.925016+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336408\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:37:21.336523\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.377+0000 7f8a50b81700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expand map: {default=false} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta from 'false' to 'false' 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expanded map: {default=false} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expand map: {default=info} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta from 'info' to 'info' 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expanded map: {default=info} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expand map: {default=daemon} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expanded map: {default=daemon} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expand map: {default=debug} 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta from 'debug' to 'debug' 2024-01-21T07:38:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:21 smithi080 bash[17460]: debug 2024-01-21T07:38:21.381+0000 7f8a50b81700 20 expand_channel_meta expanded map: {default=debug} 2024-01-21T07:38:26.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:21.395297+0000 mon.a (mon.0) 127 : cluster [INF] mon.a calling monitor election 2024-01-21T07:38:26.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: audit 2024-01-21T07:38:21.396419+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394695\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_daemon_update\": \"2024-01-21T07:38:21.394858\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:21.395297+0000 mon.a (mon.0) 127 : cluster [INF] mon.a calling monitor election 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: audit 2024-01-21T07:38:21.396419+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394695\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_daemon_update\": \"2024-01-21T07:38:21.394858\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:21.674665+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:23.392980+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:23.675155+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:25.675657+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:26.399622+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:26.405656+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:26.405804+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:26.405883+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-01-21T07:38:26.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:26.406231+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 67s) 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:21.674665+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:23.392980+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:23.675155+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:25.675657+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:26.399622+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:26.405656+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:26.405804+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:26.405883+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-01-21T07:38:26.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:26.406231+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 67s) 2024-01-21T07:38:26.812 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: audit 2024-01-21T07:38:26.407224+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394695\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_daemon_update\": \"2024-01-21T07:38:21.394858\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:26.812 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: cluster 2024-01-21T07:38:26.414252+0000 mon.a (mon.0) 135 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-01-21T07:38:26.812 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[17460]: audit 2024-01-21T07:38:26.417920+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394695\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_daemon_update\": \"2024-01-21T07:38:21.394858\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:26.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: audit 2024-01-21T07:38:26.407224+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394695\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_daemon_update\": \"2024-01-21T07:38:21.394858\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:26.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: cluster 2024-01-21T07:38:26.414252+0000 mon.a (mon.0) 135 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-01-21T07:38:26.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:26 smithi080 bash[13909]: audit 2024-01-21T07:38:26.417920+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394695\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}}, \"last_daemon_update\": \"2024-01-21T07:38:21.394858\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:28.005 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:38:28.005 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"fsid":"b86415d2-b82f-11ee-95b0-87774f69a715","modified":"2024-01-21T07:38:21.390894Z","created":"2024-01-21T07:36:38.219076Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3301","nonce":0},{"type":"v1","addr":"172.21.15.80:6790","nonce":0}]},"addr":"172.21.15.80:6790/0","public_addr":"172.21.15.80:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-01-21T07:38:28.007 INFO:teuthology.orchestra.run.smithi080.stderr:dumped monmap epoch 2 2024-01-21T07:38:28.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:27 smithi080 bash[13909]: cluster 2024-01-21T07:38:27.676145+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:28.051 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:27 smithi080 bash[17460]: cluster 2024-01-21T07:38:27.676145+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:28.660 INFO:tasks.cephadm:Adding mon.b on smithi195 2024-01-21T07:38:28.660 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add mon smithi195:172.21.15.195=b 2024-01-21T07:38:29.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:28 smithi080 bash[13909]: audit 2024-01-21T07:38:28.003076+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.15.80:0/4185467731' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-21T07:38:29.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:28 smithi080 bash[17460]: audit 2024-01-21T07:38:28.003076+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.15.80:0/4185467731' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-21T07:38:30.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:29 smithi080 bash[17460]: cluster 2024-01-21T07:38:29.676752+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:29 smithi080 bash[13909]: cluster 2024-01-21T07:38:29.676752+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:31.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:31 smithi080 bash[13909]: audit 2024-01-21T07:38:31.227891+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:38:31.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:31 smithi080 bash[13909]: audit 2024-01-21T07:38:31.229697+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:31.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:31 smithi080 bash[13909]: audit 2024-01-21T07:38:31.231780+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-01-21T07:38:31.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:31 smithi080 bash[17460]: audit 2024-01-21T07:38:31.227891+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:38:31.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:31 smithi080 bash[17460]: audit 2024-01-21T07:38:31.229697+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:31.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:31 smithi080 bash[17460]: audit 2024-01-21T07:38:31.231780+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-01-21T07:38:32.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:32 smithi080 bash[13909]: audit 2024-01-21T07:38:31.225377+0000 mgr.y (mgr.14140) 34 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi195:172.21.15.195=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:32.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:32 smithi080 bash[13909]: cephadm 2024-01-21T07:38:31.231157+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Deploying daemon mon.b on smithi195 2024-01-21T07:38:32.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:32 smithi080 bash[13909]: cluster 2024-01-21T07:38:31.677280+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:32.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:32 smithi080 bash[17460]: audit 2024-01-21T07:38:31.225377+0000 mgr.y (mgr.14140) 34 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi195:172.21.15.195=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:32.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:32 smithi080 bash[17460]: cephadm 2024-01-21T07:38:31.231157+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Deploying daemon mon.b on smithi195 2024-01-21T07:38:32.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:32 smithi080 bash[17460]: cluster 2024-01-21T07:38:31.677280+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:35.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:34 smithi080 bash[13909]: cluster 2024-01-21T07:38:33.677756+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:35.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:34 smithi080 bash[17460]: cluster 2024-01-21T07:38:33.677756+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:35.236 INFO:teuthology.orchestra.run.smithi195.stdout:Deployed mon.b on host 'smithi195' 2024-01-21T07:38:36.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[13909]: audit 2024-01-21T07:38:35.182608+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:36.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[13909]: audit 2024-01-21T07:38:35.183478+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[17460]: audit 2024-01-21T07:38:35.182608+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[17460]: audit 2024-01-21T07:38:35.183478+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[13909]: audit 2024-01-21T07:38:35.189743+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[13909]: audit 2024-01-21T07:38:35.453546+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_daemon_update\": \"2024-01-21T07:38:35.452516\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[13909]: audit 2024-01-21T07:38:35.460718+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_daemon_update\": \"2024-01-21T07:38:35.452516\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[17460]: audit 2024-01-21T07:38:35.189743+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[17460]: audit 2024-01-21T07:38:35.453546+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_daemon_update\": \"2024-01-21T07:38:35.452516\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:35 smithi080 bash[17460]: audit 2024-01-21T07:38:35.460718+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_daemon_update\": \"2024-01-21T07:38:35.452516\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:36.143 DEBUG:teuthology.orchestra.run.smithi195:mon.b> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.b.service 2024-01-21T07:38:36.145 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-21T07:38:36.145 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph mon dump -f json 2024-01-21T07:38:37.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:38:37.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.364+0000 7fbf1f9b26c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.364+0000 7fbf1f9b26c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.364+0000 7fbf1f9b26c0 0 pidfile_write: ignore empty --pid-file 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.368+0000 7fbf1f9b26c0 0 load: jerasure load: lrc load: isa 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 0 set rocksdb option compression = kNoCompression 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 0 set rocksdb option write_buffer_size = 33554432 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 1 rocksdb: do_open column families: [default] 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: RocksDB version: 6.1.2 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Compile date Mar 23 2020 2024-01-21T07:38:37.074 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: DB SUMMARY 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: CURRENT file: CURRENT 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: IDENTITY file: IDENTITY 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 610 ; 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.create_if_missing: 0 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.env: 0x562d09a5a1a0 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.info_log: 0x562d0bede9a0 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:38:37.075 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:38:37.076 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:38:37.076 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:38:37.076 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.db_log_dir: 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:38:37.077 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.write_buffer_manager: 0x562d0ca78a80 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:38:37.078 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.row_cache: None 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.wal_filter: None 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:38:37.079 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:38:37.080 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Compression algorithms supported: 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kZSTD supported: 0 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.merge_operator: 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:38:37.081 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562d0bdfe138) 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: cache_index_and_filter_blocks: 1 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: cache_index_and_filter_blocks_with_high_priority: 1 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: pin_top_level_index_and_filter: 1 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: index_type: 0 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: data_block_index_type: 0 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: hash_index_allow_collision: 1 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: checksum: 1 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: no_block_cache: 0 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_cache: 0x562d0be34610 2024-01-21T07:38:37.082 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_cache_name: BinnedLRUCache 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_cache_options: 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: capacity : 536870912 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: num_shard_bits : 4 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: strict_capacity_limit : 0 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: high_pri_pool_ratio: 0.000 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_cache_compressed: (nil) 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: persistent_cache: (nil) 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_size: 4096 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_size_deviation: 10 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_restart_interval: 16 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: index_block_restart_interval: 1 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: metadata_block_size: 4096 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: partition_filters: 0 2024-01-21T07:38:37.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: use_delta_encoding: 1 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: whole_key_filtering: 1 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: verify_compression: 0 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: read_amp_bytes_per_bit: 0 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: format_version: 2 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: enable_index_compression: 1 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: block_align: 0 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:38:37.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.num_levels: 7 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:38:37.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:38:37.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:38:37.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:38:37.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:38:37.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:38:37.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:38:37.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:38:37.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:38:37.088 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:38:37.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: Options.ttl: 0 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822716377905, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822716378873, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1524, "table_properties": {"data_size": 622, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.372+0000 7fbf1f9b26c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf1f9b26c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705822716379600, "job": 1, "event": "recovery_finished"} 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf1f9b26c0 4 rocksdb: DB pointer 0x562d0bed0400 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf1f9b26c0 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf1f9b26c0 0 using public_addr v2:172.21.15.195:0/0 -> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf1f9b26c0 0 starting mon.b rank -1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf06aff700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.376+0000 7fbf06aff700 4 rocksdb: [db/db_impl.cc:778] 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** DB Stats ** 2024-01-21T07:38:37.090 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** Compaction Stats [default] ** 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** Compaction Stats [default] ** 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:37.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** Compaction Stats [default] ** 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.092 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** Compaction Stats [default] ** 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Uptime(secs): 0.0 total, 0.0 interval 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Flush(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:37.093 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.380+0000 7fbf1f9b26c0 1 mon.b@-1(???) e0 preinit fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 0 mon.b@-1(synchronizing).mds e1 new map 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: e1 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: enable_multiple, ever_enabled_multiple: 0,0 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: legacy client fscid: -1 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: 2024-01-21T07:38:37.095 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: No filesystems configured 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.420+0000 7fbf09304700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:38:37.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: audit 2024-01-21T07:38:35.182608+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: audit 2024-01-21T07:38:35.183478+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: audit 2024-01-21T07:38:35.189743+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: audit 2024-01-21T07:38:35.453546+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_daemon_update\": \"2024-01-21T07:38:35.452516\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: audit 2024-01-21T07:38:35.460718+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}}, \"last_daemon_update\": \"2024-01-21T07:38:35.452516\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expand map: {default=false} 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta from 'false' to 'false' 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expanded map: {default=false} 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expand map: {default=info} 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta from 'info' to 'info' 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expanded map: {default=info} 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expand map: {default=daemon} 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expanded map: {default=daemon} 2024-01-21T07:38:37.097 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expand map: {default=debug} 2024-01-21T07:38:37.098 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta from 'debug' to 'debug' 2024-01-21T07:38:37.098 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:36 smithi195 bash[13978]: debug 2024-01-21T07:38:36.424+0000 7fbf09304700 20 expand_channel_meta expanded map: {default=debug} 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:36.442313+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:36.443533+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:37.678774+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:38.437353+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:39.679229+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.465561+0000 mon.a (mon.0) 147 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.471371+0000 mon.a (mon.0) 148 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.471470+0000 mon.a (mon.0) 149 : cluster [DBG] fsmap 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.471530+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.471892+0000 mon.a (mon.0) 151 : cluster [DBG] mgrmap e13: y(active, since 82s) 2024-01-21T07:38:41.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.478769+0000 mon.a (mon.0) 152 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:36.442313+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:36.443533+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:37.678774+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:38.437353+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:39.679229+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.465561+0000 mon.a (mon.0) 147 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.471371+0000 mon.a (mon.0) 148 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.471470+0000 mon.a (mon.0) 149 : cluster [DBG] fsmap 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.471530+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.471892+0000 mon.a (mon.0) 151 : cluster [DBG] mgrmap e13: y(active, since 82s) 2024-01-21T07:38:41.813 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:41 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.478769+0000 mon.a (mon.0) 152 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-01-21T07:38:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:36.442313+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2024-01-21T07:38:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:36.443533+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-01-21T07:38:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:37.678774+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:38.437353+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-01-21T07:38:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:39.679229+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.465561+0000 mon.a (mon.0) 147 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:38:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.471371+0000 mon.a (mon.0) 148 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} 2024-01-21T07:38:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.471470+0000 mon.a (mon.0) 149 : cluster [DBG] fsmap 2024-01-21T07:38:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.471530+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-01-21T07:38:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.471892+0000 mon.a (mon.0) 151 : cluster [DBG] mgrmap e13: y(active, since 82s) 2024-01-21T07:38:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:41 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.478769+0000 mon.a (mon.0) 152 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-01-21T07:38:42.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:42 smithi080 bash[13909]: cluster 2024-01-21T07:38:41.679745+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:42.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:42 smithi080 bash[17460]: cluster 2024-01-21T07:38:41.679745+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:42.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:42 smithi195 bash[13978]: cluster 2024-01-21T07:38:41.679745+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:43.096 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-21T07:38:43.096 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":3,"fsid":"b86415d2-b82f-11ee-95b0-87774f69a715","modified":"2024-01-21T07:38:36.435671Z","created":"2024-01-21T07:36:38.219076Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3301","nonce":0},{"type":"v1","addr":"172.21.15.80:6790","nonce":0}]},"addr":"172.21.15.80:6790/0","public_addr":"172.21.15.80:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2024-01-21T07:38:43.099 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 3 2024-01-21T07:38:43.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:43 smithi195 bash[13978]: audit 2024-01-21T07:38:43.093528+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.15.195:0/312491152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-21T07:38:43.764 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-01-21T07:38:43.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph config generate-minimal-conf 2024-01-21T07:38:43.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:43 smithi080 bash[13909]: audit 2024-01-21T07:38:43.093528+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.15.195:0/312491152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-21T07:38:43.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:43 smithi080 bash[17460]: audit 2024-01-21T07:38:43.093528+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.15.195:0/312491152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-21T07:38:44.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:44 smithi080 bash[13909]: cluster 2024-01-21T07:38:43.680260+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:44.916 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:44 smithi080 bash[17460]: cluster 2024-01-21T07:38:43.680260+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:45.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:44 smithi195 bash[13978]: cluster 2024-01-21T07:38:43.680260+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:45 smithi080 bash[13909]: cluster 2024-01-21T07:38:45.680783+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:46.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:45 smithi080 bash[17460]: cluster 2024-01-21T07:38:45.680783+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:45 smithi195 bash[13978]: cluster 2024-01-21T07:38:45.680783+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:46.212 INFO:teuthology.orchestra.run.smithi080.stdout:# minimal ceph.conf for b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:38:46.212 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-01-21T07:38:46.212 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:38:46.212 INFO:teuthology.orchestra.run.smithi080.stdout: mon_host = [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] 2024-01-21T07:38:46.884 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-01-21T07:38:46.885 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:38:46.885 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-01-21T07:38:46.901 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:38:46.901 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-21T07:38:46.957 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:38:46.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-01-21T07:38:46.975 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:38:46.975 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-21T07:38:46.984 INFO:tasks.cephadm:Adding mgr.y on smithi080 2024-01-21T07:38:46.984 INFO:tasks.cephadm:Adding mgr.x on smithi195 2024-01-21T07:38:46.984 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch apply mgr '2;smithi080=y;smithi195=x' 2024-01-21T07:38:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:46 smithi080 bash[13909]: audit 2024-01-21T07:38:46.210324+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.80:0/1220011251' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:47.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:46 smithi080 bash[17460]: audit 2024-01-21T07:38:46.210324+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.80:0/1220011251' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:47.115 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:46 smithi195 bash[13978]: audit 2024-01-21T07:38:46.210324+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.80:0/1220011251' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:48.050 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:47 smithi195 bash[13978]: cluster 2024-01-21T07:38:47.681270+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:47 smithi080 bash[13909]: cluster 2024-01-21T07:38:47.681270+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:47 smithi080 bash[17460]: cluster 2024-01-21T07:38:47.681270+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:49.428 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mgr update... 2024-01-21T07:38:49.784 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:49 smithi195 bash[13978]: audit 2024-01-21T07:38:49.417934+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-01-21T07:38:49.417184\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-01-21T07:38:49.784 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:49 smithi195 bash[13978]: audit 2024-01-21T07:38:49.423392+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-01-21T07:38:49.417184\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-01-21T07:38:49.784 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:49 smithi195 bash[13978]: audit 2024-01-21T07:38:49.427385+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:38:49.784 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:49 smithi195 bash[13978]: audit 2024-01-21T07:38:49.431788+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-21T07:38:49.785 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:49 smithi195 bash[13978]: audit 2024-01-21T07:38:49.433813+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:49.785 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:49 smithi195 bash[13978]: audit 2024-01-21T07:38:49.436294+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[13909]: audit 2024-01-21T07:38:49.417934+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-01-21T07:38:49.417184\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[13909]: audit 2024-01-21T07:38:49.423392+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-01-21T07:38:49.417184\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[13909]: audit 2024-01-21T07:38:49.427385+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[13909]: audit 2024-01-21T07:38:49.431788+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[13909]: audit 2024-01-21T07:38:49.433813+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[13909]: audit 2024-01-21T07:38:49.436294+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[17460]: audit 2024-01-21T07:38:49.417934+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-01-21T07:38:49.417184\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[17460]: audit 2024-01-21T07:38:49.423392+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-01-21T07:38:49.417184\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-01-21T07:38:50.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[17460]: audit 2024-01-21T07:38:49.427385+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:38:50.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[17460]: audit 2024-01-21T07:38:49.431788+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-21T07:38:50.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[17460]: audit 2024-01-21T07:38:49.433813+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:50.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:49 smithi080 bash[17460]: audit 2024-01-21T07:38:49.436294+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-01-21T07:38:50.383 DEBUG:teuthology.orchestra.run.smithi195:mgr.x> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x.service 2024-01-21T07:38:50.385 INFO:tasks.cephadm:Deploying OSDs... 2024-01-21T07:38:50.385 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:38:50.385 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-01-21T07:38:50.393 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-21T07:38:50.393 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-01-21T07:38:50.400 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-21T07:38:50.400 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.400 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-01-21T07:38:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-01-21 07:34:26.782368402 +0000 2024-01-21T07:38:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-01-21 07:34:26.778368494 +0000 2024-01-21T07:38:50.401 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-01-21 07:34:26.778368494 +0000 2024-01-21T07:38:50.401 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-01-21T07:38:50.401 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-21T07:38:50.458 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-01-21T07:38:50.458 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-01-21T07:38:50.458 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000448936 s, 1.1 MB/s 2024-01-21T07:38:50.459 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-21T07:38:50.468 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-01-21 07:34:27.450353012 +0000 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-01-21 07:34:27.250357620 +0000 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-01-21 07:34:27.250357620 +0000 2024-01-21T07:38:50.474 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-01-21T07:38:50.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-21T07:38:50.530 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-01-21T07:38:50.530 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-01-21T07:38:50.530 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000404467 s, 1.3 MB/s 2024-01-21T07:38:50.532 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-21T07:38:50.539 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-01-21T07:38:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-21T07:38:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.543 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-01-21T07:38:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-01-21 07:34:27.894342783 +0000 2024-01-21T07:38:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-01-21 07:34:27.710347021 +0000 2024-01-21T07:38:50.544 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-01-21 07:34:27.710347021 +0000 2024-01-21T07:38:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-01-21T07:38:50.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-21T07:38:50.602 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-01-21T07:38:50.602 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-01-21T07:38:50.602 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000400944 s, 1.3 MB/s 2024-01-21T07:38:50.603 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-21T07:38:50.611 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-01-21T07:38:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-01-21 07:34:28.342332461 +0000 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-01-21 07:34:28.126337438 +0000 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-01-21 07:34:28.126337438 +0000 2024-01-21T07:38:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-01-21T07:38:50.618 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-21T07:38:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-01-21T07:38:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-01-21T07:38:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000376024 s, 1.4 MB/s 2024-01-21T07:38:50.675 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-21T07:38:50.682 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:38:50.682 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-01-21T07:38:50.689 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-21T07:38:50.689 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-21 07:34:26.101360533 +0000 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-21 07:34:25.897365236 +0000 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-21 07:34:25.897365236 +0000 2024-01-21T07:38:50.697 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-01-21T07:38:50.698 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-21T07:38:50.708 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-21T07:38:50.708 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-21T07:38:50.708 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000204372 s, 2.5 MB/s 2024-01-21T07:38:50.709 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-21T07:38:50.765 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 364 Links: 1 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-21 07:34:26.533350575 +0000 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-21 07:34:26.297356016 +0000 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-21 07:34:26.297356016 +0000 2024-01-21T07:38:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-01-21T07:38:50.773 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-21T07:38:50.784 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-21T07:38:50.784 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-21T07:38:50.784 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.00018033 s, 2.8 MB/s 2024-01-21T07:38:50.785 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-21T07:38:50.791 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-21 07:34:26.977340341 +0000 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-21 07:34:26.757345413 +0000 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-21 07:34:26.757345413 +0000 2024-01-21T07:38:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-01-21T07:38:50.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[17460]: audit 2024-01-21T07:38:49.415939+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi195=x", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[17460]: cephadm 2024-01-21T07:38:49.417148+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Saving service mgr spec with placement count:2 smithi080=y,smithi195=x 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[17460]: cephadm 2024-01-21T07:38:49.435211+0000 mgr.y (mgr.14140) 47 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[17460]: cluster 2024-01-21T07:38:49.681698+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[13909]: audit 2024-01-21T07:38:49.415939+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi195=x", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[13909]: cephadm 2024-01-21T07:38:49.417148+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Saving service mgr spec with placement count:2 smithi080=y,smithi195=x 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[13909]: cephadm 2024-01-21T07:38:49.435211+0000 mgr.y (mgr.14140) 47 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:38:50.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:50 smithi080 bash[13909]: cluster 2024-01-21T07:38:49.681698+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:50.813 INFO:journalctl@ceph.mgr.x.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:38:50.823 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-21T07:38:50.823 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-21T07:38:50.823 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000218444 s, 2.3 MB/s 2024-01-21T07:38:50.824 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-21T07:38:50.874 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 376 Links: 1 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-21 07:34:27.381331029 +0000 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-21 07:34:27.201335178 +0000 2024-01-21T07:38:50.882 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-21 07:34:27.201335178 +0000 2024-01-21T07:38:50.883 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-01-21T07:38:50.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-21T07:38:50.896 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-21T07:38:50.896 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-21T07:38:50.896 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000298803 s, 1.7 MB/s 2024-01-21T07:38:50.897 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-21T07:38:50.905 INFO:tasks.cephadm:Deploying osd.0 on smithi080 with /dev/vg_nvme/lv_4... 2024-01-21T07:38:50.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-21T07:38:51.032 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:50 smithi195 bash[13978]: audit 2024-01-21T07:38:49.415939+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi195=x", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:51.033 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:50 smithi195 bash[13978]: cephadm 2024-01-21T07:38:49.417148+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Saving service mgr spec with placement count:2 smithi080=y,smithi195=x 2024-01-21T07:38:51.033 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:50 smithi195 bash[13978]: cephadm 2024-01-21T07:38:49.435211+0000 mgr.y (mgr.14140) 47 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:38:51.033 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:50 smithi195 bash[13978]: cluster 2024-01-21T07:38:49.681698+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:51 smithi080 bash[13909]: cluster 2024-01-21T07:38:51.682175+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:51 smithi080 bash[17460]: cluster 2024-01-21T07:38:51.682175+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:52.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:51 smithi195 bash[13978]: cluster 2024-01-21T07:38:51.682175+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:52.140 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:38:51 smithi195 docker[14652]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.x 2024-01-21T07:38:52.140 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:38:51 smithi195 systemd[1]: Started Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:51.948840+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:51.955276+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:51.958338+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:52.752016+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_daemon_update\": \"2024-01-21T07:38:52.750716\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:52.757630+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_daemon_update\": \"2024-01-21T07:38:52.750716\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:52.760488+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:52.762502+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:52.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:52 smithi195 bash[13978]: audit 2024-01-21T07:38:52.764334+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-01-21T07:38:53.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:51.948840+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:53.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:51.948840+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:53.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:51.955276+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:53.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:51.958338+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:53.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:51.955276+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:35.452271\", \"created\": \"2024-01-21T07:38:35.160135\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:53.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:51.958338+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:53.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:52.752016+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_daemon_update\": \"2024-01-21T07:38:52.750716\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:53.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:52.752016+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_daemon_update\": \"2024-01-21T07:38:52.750716\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:38:53.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:52.757630+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_daemon_update\": \"2024-01-21T07:38:52.750716\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:53.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:52.760488+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-01-21T07:38:53.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:52.762502+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:53.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[13909]: audit 2024-01-21T07:38:52.764334+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-01-21T07:38:53.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:52.757630+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}}, \"last_daemon_update\": \"2024-01-21T07:38:52.750716\", \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:38:53.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:52.760488+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-01-21T07:38:53.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:52.762502+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:53.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:52 smithi080 bash[17460]: audit 2024-01-21T07:38:52.764334+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-01-21T07:38:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-21T07:38:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-21T07:38:53.948 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-01-21T07:38:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-01-21T07:38:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0196115 s, 535 MB/s 2024-01-21T07:38:53.948 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-01-21T07:38:54.886 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:54 smithi080 bash[17460]: cephadm 2024-01-21T07:38:52.759898+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-01-21T07:38:54.886 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:54 smithi080 bash[17460]: cephadm 2024-01-21T07:38:52.763808+0000 mgr.y (mgr.14140) 51 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-01-21T07:38:54.886 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:54 smithi080 bash[17460]: cluster 2024-01-21T07:38:53.682713+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:54 smithi080 bash[13909]: cephadm 2024-01-21T07:38:52.759898+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-01-21T07:38:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:54 smithi080 bash[13909]: cephadm 2024-01-21T07:38:52.763808+0000 mgr.y (mgr.14140) 51 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-01-21T07:38:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:54 smithi080 bash[13909]: cluster 2024-01-21T07:38:53.682713+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:54.887 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-01-21T07:38:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:54 smithi195 bash[13978]: cephadm 2024-01-21T07:38:52.759898+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-01-21T07:38:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:54 smithi195 bash[13978]: cephadm 2024-01-21T07:38:52.763808+0000 mgr.y (mgr.14140) 51 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-01-21T07:38:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:54 smithi195 bash[13978]: cluster 2024-01-21T07:38:53.682713+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:55.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[13909]: audit 2024-01-21T07:38:54.825940+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:55.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[13909]: audit 2024-01-21T07:38:54.831648+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:55.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[13909]: audit 2024-01-21T07:38:54.833395+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:55.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[13909]: audit 2024-01-21T07:38:55.487871+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_daemon_update\": \"2024-01-21T07:38:55.487111\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:55.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[13909]: audit 2024-01-21T07:38:55.491831+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_daemon_update\": \"2024-01-21T07:38:55.487111\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:55.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[17460]: audit 2024-01-21T07:38:54.825940+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:55.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[17460]: audit 2024-01-21T07:38:54.831648+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:55.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[17460]: audit 2024-01-21T07:38:54.833395+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:55.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[17460]: audit 2024-01-21T07:38:55.487871+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_daemon_update\": \"2024-01-21T07:38:55.487111\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:55.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:55 smithi080 bash[17460]: audit 2024-01-21T07:38:55.491831+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_daemon_update\": \"2024-01-21T07:38:55.487111\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:55 smithi195 bash[13978]: audit 2024-01-21T07:38:54.825940+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:55 smithi195 bash[13978]: audit 2024-01-21T07:38:54.831648+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394590\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:21.394745\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:55 smithi195 bash[13978]: audit 2024-01-21T07:38:54.833395+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:38:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:55 smithi195 bash[13978]: audit 2024-01-21T07:38:55.487871+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_daemon_update\": \"2024-01-21T07:38:55.487111\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:38:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:55 smithi195 bash[13978]: audit 2024-01-21T07:38:55.491831+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}}, \"last_daemon_update\": \"2024-01-21T07:38:55.487111\", \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:38:56.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:56 smithi080 bash[13909]: cluster 2024-01-21T07:38:55.683273+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:56.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:56 smithi080 bash[17460]: cluster 2024-01-21T07:38:55.683273+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:57.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:56 smithi195 bash[13978]: cluster 2024-01-21T07:38:55.683273+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[13909]: cluster 2024-01-21T07:38:56.911271+0000 mon.a (mon.0) 174 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[13909]: audit 2024-01-21T07:38:56.913636+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.195:0/199362206' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[13909]: audit 2024-01-21T07:38:56.915925+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.195:0/199362206' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[13909]: audit 2024-01-21T07:38:57.538147+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[13909]: audit 2024-01-21T07:38:57.539515+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[13909]: audit 2024-01-21T07:38:57.541103+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[17460]: cluster 2024-01-21T07:38:56.911271+0000 mon.a (mon.0) 174 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:38:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[17460]: audit 2024-01-21T07:38:56.913636+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.195:0/199362206' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:38:58.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[17460]: audit 2024-01-21T07:38:56.915925+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.195:0/199362206' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:38:58.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[17460]: audit 2024-01-21T07:38:57.538147+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:38:58.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[17460]: audit 2024-01-21T07:38:57.539515+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:58.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:57 smithi080 bash[17460]: audit 2024-01-21T07:38:57.541103+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:38:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:57 smithi195 bash[13978]: cluster 2024-01-21T07:38:56.911271+0000 mon.a (mon.0) 174 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:38:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:57 smithi195 bash[13978]: audit 2024-01-21T07:38:56.913636+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.195:0/199362206' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:38:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:57 smithi195 bash[13978]: audit 2024-01-21T07:38:56.915925+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.195:0/199362206' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:38:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:57 smithi195 bash[13978]: audit 2024-01-21T07:38:57.538147+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:38:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:57 smithi195 bash[13978]: audit 2024-01-21T07:38:57.539515+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:38:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:57 smithi195 bash[13978]: audit 2024-01-21T07:38:57.541103+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:38:58.779 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[17460]: audit 2024-01-21T07:38:57.535486+0000 mgr.y (mgr.14140) 54 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[17460]: cephadm 2024-01-21T07:38:57.537598+0000 mgr.y (mgr.14140) 55 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[17460]: cluster 2024-01-21T07:38:57.683676+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[17460]: cluster 2024-01-21T07:38:57.706466+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e14: y(active, since 98s), standbys: x 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[17460]: audit 2024-01-21T07:38:57.706663+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[13909]: audit 2024-01-21T07:38:57.535486+0000 mgr.y (mgr.14140) 54 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[13909]: cephadm 2024-01-21T07:38:57.537598+0000 mgr.y (mgr.14140) 55 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[13909]: cluster 2024-01-21T07:38:57.683676+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[13909]: cluster 2024-01-21T07:38:57.706466+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e14: y(active, since 98s), standbys: x 2024-01-21T07:38:58.780 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:38:58 smithi080 bash[13909]: audit 2024-01-21T07:38:57.706663+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:38:59.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:58 smithi195 bash[13978]: audit 2024-01-21T07:38:57.535486+0000 mgr.y (mgr.14140) 54 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:38:59.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:58 smithi195 bash[13978]: cephadm 2024-01-21T07:38:57.537598+0000 mgr.y (mgr.14140) 55 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:38:59.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:58 smithi195 bash[13978]: cluster 2024-01-21T07:38:57.683676+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:38:59.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:58 smithi195 bash[13978]: cluster 2024-01-21T07:38:57.706466+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e14: y(active, since 98s), standbys: x 2024-01-21T07:38:59.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:38:58 smithi195 bash[13978]: audit 2024-01-21T07:38:57.706663+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[13909]: cluster 2024-01-21T07:38:59.684233+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[13909]: audit 2024-01-21T07:39:00.643428+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.80:0/2210340896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]: dispatch 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[13909]: audit 2024-01-21T07:39:00.643999+0000 mon.a (mon.0) 180 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]: dispatch 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[13909]: audit 2024-01-21T07:39:00.653406+0000 mon.a (mon.0) 181 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]': finished 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[13909]: cluster 2024-01-21T07:39:00.653524+0000 mon.a (mon.0) 182 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[13909]: audit 2024-01-21T07:39:00.653768+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:01.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[17460]: cluster 2024-01-21T07:38:59.684233+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:01.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[17460]: audit 2024-01-21T07:39:00.643428+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.80:0/2210340896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]: dispatch 2024-01-21T07:39:01.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[17460]: audit 2024-01-21T07:39:00.643999+0000 mon.a (mon.0) 180 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]: dispatch 2024-01-21T07:39:01.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[17460]: audit 2024-01-21T07:39:00.653406+0000 mon.a (mon.0) 181 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]': finished 2024-01-21T07:39:01.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[17460]: cluster 2024-01-21T07:39:00.653524+0000 mon.a (mon.0) 182 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-01-21T07:39:01.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:00 smithi080 bash[17460]: audit 2024-01-21T07:39:00.653768+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:00 smithi195 bash[13978]: cluster 2024-01-21T07:38:59.684233+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:00 smithi195 bash[13978]: audit 2024-01-21T07:39:00.643428+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.80:0/2210340896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]: dispatch 2024-01-21T07:39:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:00 smithi195 bash[13978]: audit 2024-01-21T07:39:00.643999+0000 mon.a (mon.0) 180 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]: dispatch 2024-01-21T07:39:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:00 smithi195 bash[13978]: audit 2024-01-21T07:39:00.653406+0000 mon.a (mon.0) 181 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ef0e6e3-19f4-49c4-9074-c94be9e385bf"}]': finished 2024-01-21T07:39:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:00 smithi195 bash[13978]: cluster 2024-01-21T07:39:00.653524+0000 mon.a (mon.0) 182 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-01-21T07:39:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:00 smithi195 bash[13978]: audit 2024-01-21T07:39:00.653768+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:03.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:02 smithi080 bash[13909]: cluster 2024-01-21T07:39:01.684862+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:03.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:02 smithi080 bash[17460]: cluster 2024-01-21T07:39:01.684862+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:03.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:02 smithi195 bash[13978]: cluster 2024-01-21T07:39:01.684862+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:04.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:03 smithi080 bash[13909]: audit 2024-01-21T07:39:02.754098+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.80:0/1323218787' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:04.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:03 smithi080 bash[17460]: audit 2024-01-21T07:39:02.754098+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.80:0/1323218787' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:04.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:03 smithi195 bash[13978]: audit 2024-01-21T07:39:02.754098+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.80:0/1323218787' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:05.054 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:04 smithi080 bash[13909]: cluster 2024-01-21T07:39:03.685339+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:05.054 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:04 smithi080 bash[17460]: cluster 2024-01-21T07:39:03.685339+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:04 smithi195 bash[13978]: cluster 2024-01-21T07:39:03.685339+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:05 smithi080 bash[13909]: audit 2024-01-21T07:39:05.496097+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:06.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:05 smithi080 bash[13909]: cluster 2024-01-21T07:39:05.685705+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:05 smithi080 bash[17460]: audit 2024-01-21T07:39:05.496097+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:05 smithi080 bash[17460]: cluster 2024-01-21T07:39:05.685705+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:05 smithi195 bash[13978]: audit 2024-01-21T07:39:05.496097+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:05 smithi195 bash[13978]: cluster 2024-01-21T07:39:05.685705+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:08.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:07 smithi080 bash[13909]: cluster 2024-01-21T07:39:07.686207+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:08.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:07 smithi080 bash[17460]: cluster 2024-01-21T07:39:07.686207+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:08.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:07 smithi195 bash[13978]: cluster 2024-01-21T07:39:07.686207+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:09.935 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:09 smithi080 bash[13909]: audit 2024-01-21T07:39:08.810402+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:39:09.936 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:09 smithi080 bash[13909]: audit 2024-01-21T07:39:08.812223+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:09.936 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:09 smithi080 bash[13909]: audit 2024-01-21T07:39:08.814116+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-01-21T07:39:09.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:09 smithi080 bash[17460]: audit 2024-01-21T07:39:08.810402+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:39:09.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:09 smithi080 bash[17460]: audit 2024-01-21T07:39:08.812223+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:09.936 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:09 smithi080 bash[17460]: audit 2024-01-21T07:39:08.814116+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-01-21T07:39:10.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:09 smithi195 bash[13978]: audit 2024-01-21T07:39:08.810402+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:39:10.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:09 smithi195 bash[13978]: audit 2024-01-21T07:39:08.812223+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:10.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:09 smithi195 bash[13978]: audit 2024-01-21T07:39:08.814116+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-01-21T07:39:10.687 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:10 smithi080 bash[17460]: cephadm 2024-01-21T07:39:08.813518+0000 mgr.y (mgr.14140) 62 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-01-21T07:39:10.688 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:10 smithi080 bash[17460]: cluster 2024-01-21T07:39:09.686689+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:10.840 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 0 on host 'smithi080' 2024-01-21T07:39:11.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:10 smithi080 bash[13909]: cephadm 2024-01-21T07:39:08.813518+0000 mgr.y (mgr.14140) 62 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-01-21T07:39:11.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:10 smithi080 bash[13909]: cluster 2024-01-21T07:39:09.686689+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:10 smithi195 bash[13978]: cephadm 2024-01-21T07:39:08.813518+0000 mgr.y (mgr.14140) 62 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-01-21T07:39:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:10 smithi195 bash[13978]: cluster 2024-01-21T07:39:09.686689+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:12.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:11 smithi080 bash[17460]: audit 2024-01-21T07:39:10.831132+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:12.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:11 smithi080 bash[17460]: audit 2024-01-21T07:39:10.831662+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:12.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:11 smithi080 bash[17460]: audit 2024-01-21T07:39:10.836428+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:12.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:11 smithi080 bash[13909]: audit 2024-01-21T07:39:10.831132+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:12.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:11 smithi080 bash[13909]: audit 2024-01-21T07:39:10.831662+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:12.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:11 smithi080 bash[13909]: audit 2024-01-21T07:39:10.836428+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:12.063 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.0.service 2024-01-21T07:39:12.065 INFO:tasks.cephadm:Deploying osd.1 on smithi080 with /dev/vg_nvme/lv_3... 2024-01-21T07:39:12.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-21T07:39:12.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:11 smithi195 bash[13978]: audit 2024-01-21T07:39:10.831132+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:12.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:11 smithi195 bash[13978]: audit 2024-01-21T07:39:10.831662+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:12.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:11 smithi195 bash[13978]: audit 2024-01-21T07:39:10.836428+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486644\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486818\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:55.486927\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_device_update\": \"2024-01-21T07:37:27.210636\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[13909]: cluster 2024-01-21T07:39:11.687152+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:12.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[17460]: cluster 2024-01-21T07:39:11.687152+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:12.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[13909]: audit 2024-01-21T07:39:11.928537+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:12.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[17460]: audit 2024-01-21T07:39:11.928537+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:12.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[13909]: audit 2024-01-21T07:39:11.932868+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:12.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[13909]: audit 2024-01-21T07:39:11.934306+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:12.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[17460]: audit 2024-01-21T07:39:11.932868+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:12.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[17460]: audit 2024-01-21T07:39:11.934306+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:13.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:12 smithi195 bash[13978]: cluster 2024-01-21T07:39:11.687152+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:13.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:12 smithi195 bash[13978]: audit 2024-01-21T07:39:11.928537+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:13.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:12 smithi195 bash[13978]: audit 2024-01-21T07:39:11.932868+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:13.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:12 smithi195 bash[13978]: audit 2024-01-21T07:39:11.934306+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:13.870 INFO:journalctl@ceph.osd.0.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-21T07:39:13.871 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:12 smithi080 bash[19226]: --> ceph-volume lvm activate successful for osd ID: 0 2024-01-21T07:39:14.956 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:14 smithi080 bash[13909]: cluster 2024-01-21T07:39:13.687687+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:14.956 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:14 smithi080 bash[17460]: cluster 2024-01-21T07:39:13.687687+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:15.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:14 smithi195 bash[13978]: cluster 2024-01-21T07:39:13.687687+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:15 smithi080 bash[13909]: cluster 2024-01-21T07:39:15.688186+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:15 smithi080 bash[17460]: cluster 2024-01-21T07:39:15.688186+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:16.059 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:15 smithi080 bash[19444]: debug 2024-01-21T07:39:15.768+0000 7fdd36a94ec0 -1 Falling back to public interface 2024-01-21T07:39:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:15 smithi195 bash[13978]: cluster 2024-01-21T07:39:15.688186+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:16.780 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:16 smithi080 bash[19444]: debug 2024-01-21T07:39:16.408+0000 7fdd36a94ec0 -1 osd.0 0 log_to_monitors {default=true} 2024-01-21T07:39:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:16 smithi080 bash[13909]: audit 2024-01-21T07:39:16.419640+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:39:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:16 smithi080 bash[13909]: audit 2024-01-21T07:39:16.420236+0000 mon.a (mon.0) 194 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:39:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:16 smithi080 bash[17460]: audit 2024-01-21T07:39:16.419640+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:39:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:16 smithi080 bash[17460]: audit 2024-01-21T07:39:16.420236+0000 mon.a (mon.0) 194 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:39:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:16 smithi195 bash[13978]: audit 2024-01-21T07:39:16.419640+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:39:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:16 smithi195 bash[13978]: audit 2024-01-21T07:39:16.420236+0000 mon.a (mon.0) 194 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:39:17.594 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-21T07:39:17.594 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-21T07:39:17.594 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-01-21T07:39:17.594 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-01-21T07:39:17.594 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0169634 s, 618 MB/s 2024-01-21T07:39:17.594 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-01-21T07:39:18.059 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[19444]: debug 2024-01-21T07:39:17.796+0000 7fdd1b841700 -1 osd.0 0 waiting for initial osdmap 2024-01-21T07:39:18.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: audit 2024-01-21T07:39:16.788655+0000 mon.a (mon.0) 195 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-21T07:39:18.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: cluster 2024-01-21T07:39:16.788741+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-01-21T07:39:18.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: audit 2024-01-21T07:39:16.788922+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:18.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: audit 2024-01-21T07:39:16.789600+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:18.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: audit 2024-01-21T07:39:16.790088+0000 mon.a (mon.0) 198 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:18.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: cluster 2024-01-21T07:39:17.380190+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: cluster 2024-01-21T07:39:17.380262+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[13909]: cluster 2024-01-21T07:39:17.688695+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: audit 2024-01-21T07:39:16.788655+0000 mon.a (mon.0) 195 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: cluster 2024-01-21T07:39:16.788741+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: audit 2024-01-21T07:39:16.788922+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: audit 2024-01-21T07:39:16.789600+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: audit 2024-01-21T07:39:16.790088+0000 mon.a (mon.0) 198 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: cluster 2024-01-21T07:39:17.380190+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: cluster 2024-01-21T07:39:17.380262+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:39:18.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:17 smithi080 bash[17460]: cluster 2024-01-21T07:39:17.688695+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: audit 2024-01-21T07:39:16.788655+0000 mon.a (mon.0) 195 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: cluster 2024-01-21T07:39:16.788741+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: audit 2024-01-21T07:39:16.788922+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: audit 2024-01-21T07:39:16.789600+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: audit 2024-01-21T07:39:16.790088+0000 mon.a (mon.0) 198 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: cluster 2024-01-21T07:39:17.380190+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: cluster 2024-01-21T07:39:17.380262+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:39:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:17 smithi195 bash[13978]: cluster 2024-01-21T07:39:17.688695+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:18.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-01-21T07:39:19.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:18 smithi195 bash[13978]: audit 2024-01-21T07:39:17.790953+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:39:19.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:18 smithi195 bash[13978]: cluster 2024-01-21T07:39:17.791040+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-01-21T07:39:19.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:18 smithi195 bash[13978]: audit 2024-01-21T07:39:17.791835+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:19.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:18 smithi080 bash[13909]: audit 2024-01-21T07:39:17.790953+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:39:19.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:18 smithi080 bash[13909]: cluster 2024-01-21T07:39:17.791040+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-01-21T07:39:19.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:18 smithi080 bash[13909]: audit 2024-01-21T07:39:17.791835+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:19.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:18 smithi080 bash[17460]: audit 2024-01-21T07:39:17.790953+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:39:19.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:18 smithi080 bash[17460]: cluster 2024-01-21T07:39:17.791040+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-01-21T07:39:19.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:18 smithi080 bash[17460]: audit 2024-01-21T07:39:17.791835+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: cluster 2024-01-21T07:39:18.802726+0000 mon.a (mon.0) 202 : cluster [INF] osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277] boot 2024-01-21T07:39:19.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: cluster 2024-01-21T07:39:18.802876+0000 mon.a (mon.0) 203 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-01-21T07:39:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: cluster 2024-01-21T07:39:18.802726+0000 mon.a (mon.0) 202 : cluster [INF] osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277] boot 2024-01-21T07:39:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: cluster 2024-01-21T07:39:18.802876+0000 mon.a (mon.0) 203 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-01-21T07:39:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: audit 2024-01-21T07:39:18.804099+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:20.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: audit 2024-01-21T07:39:19.323614+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:20.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: audit 2024-01-21T07:39:19.544436+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:20.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: audit 2024-01-21T07:39:19.550038+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:20.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: cluster 2024-01-21T07:39:19.689179+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:20.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:19 smithi195 bash[13978]: cluster 2024-01-21T07:39:19.804944+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-01-21T07:39:20.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: audit 2024-01-21T07:39:18.804099+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:20.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: audit 2024-01-21T07:39:19.323614+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: cluster 2024-01-21T07:39:18.802726+0000 mon.a (mon.0) 202 : cluster [INF] osd.0 [v2:172.21.15.80:6802/440522277,v1:172.21.15.80:6803/440522277] boot 2024-01-21T07:39:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: cluster 2024-01-21T07:39:18.802876+0000 mon.a (mon.0) 203 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-01-21T07:39:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: audit 2024-01-21T07:39:18.804099+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:39:20.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: audit 2024-01-21T07:39:19.323614+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:20.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: audit 2024-01-21T07:39:19.544436+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:20.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: audit 2024-01-21T07:39:19.550038+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:20.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: cluster 2024-01-21T07:39:19.689179+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:20.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[13909]: cluster 2024-01-21T07:39:19.804944+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-01-21T07:39:20.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: audit 2024-01-21T07:39:19.544436+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:20.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: audit 2024-01-21T07:39:19.550038+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}}, \"last_daemon_update\": \"2024-01-21T07:39:11.927421\", \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:20.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: cluster 2024-01-21T07:39:19.689179+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-21T07:39:20.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:19 smithi080 bash[17460]: cluster 2024-01-21T07:39:19.804944+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: cluster 2024-01-21T07:39:20.808049+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: audit 2024-01-21T07:39:21.548390+0000 mgr.y (mgr.14140) 69 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: cephadm 2024-01-21T07:39:21.549776+0000 mgr.y (mgr.14140) 70 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: audit 2024-01-21T07:39:21.550227+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: audit 2024-01-21T07:39:21.551434+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: audit 2024-01-21T07:39:21.553029+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[13909]: cluster 2024-01-21T07:39:21.689816+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:22.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: cluster 2024-01-21T07:39:20.808049+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-01-21T07:39:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: audit 2024-01-21T07:39:21.548390+0000 mgr.y (mgr.14140) 69 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:39:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: cephadm 2024-01-21T07:39:21.549776+0000 mgr.y (mgr.14140) 70 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:39:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: audit 2024-01-21T07:39:21.550227+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:39:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: audit 2024-01-21T07:39:21.551434+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: audit 2024-01-21T07:39:21.553029+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:22.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:21 smithi080 bash[17460]: cluster 2024-01-21T07:39:21.689816+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:22.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: cluster 2024-01-21T07:39:20.808049+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-01-21T07:39:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: audit 2024-01-21T07:39:21.548390+0000 mgr.y (mgr.14140) 69 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:39:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: cephadm 2024-01-21T07:39:21.549776+0000 mgr.y (mgr.14140) 70 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:39:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: audit 2024-01-21T07:39:21.550227+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:39:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: audit 2024-01-21T07:39:21.551434+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: audit 2024-01-21T07:39:21.553029+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:21 smithi195 bash[13978]: cluster 2024-01-21T07:39:21.689816+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:22.949 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:22 smithi080 bash[13909]: cluster 2024-01-21T07:39:21.801769+0000 mon.a (mon.0) 213 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:39:22.950 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:22 smithi080 bash[17460]: cluster 2024-01-21T07:39:21.801769+0000 mon.a (mon.0) 213 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:39:23.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:22 smithi195 bash[13978]: cluster 2024-01-21T07:39:21.801769+0000 mon.a (mon.0) 213 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:39:25.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:24 smithi080 bash[13909]: cluster 2024-01-21T07:39:23.690422+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:25.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:24 smithi080 bash[17460]: cluster 2024-01-21T07:39:23.690422+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:25.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:24 smithi195 bash[13978]: cluster 2024-01-21T07:39:23.690422+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[13909]: audit 2024-01-21T07:39:24.856514+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.80:0/2991671653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]: dispatch 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[13909]: audit 2024-01-21T07:39:24.857266+0000 mon.a (mon.0) 214 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]: dispatch 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[13909]: audit 2024-01-21T07:39:24.864875+0000 mon.a (mon.0) 215 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]': finished 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[13909]: cluster 2024-01-21T07:39:24.864963+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[13909]: audit 2024-01-21T07:39:24.865262+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[17460]: audit 2024-01-21T07:39:24.856514+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.80:0/2991671653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]: dispatch 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[17460]: audit 2024-01-21T07:39:24.857266+0000 mon.a (mon.0) 214 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]: dispatch 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[17460]: audit 2024-01-21T07:39:24.864875+0000 mon.a (mon.0) 215 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]': finished 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[17460]: cluster 2024-01-21T07:39:24.864963+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-01-21T07:39:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:25 smithi080 bash[17460]: audit 2024-01-21T07:39:24.865262+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:26.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:25 smithi195 bash[13978]: audit 2024-01-21T07:39:24.856514+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.80:0/2991671653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]: dispatch 2024-01-21T07:39:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:25 smithi195 bash[13978]: audit 2024-01-21T07:39:24.857266+0000 mon.a (mon.0) 214 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]: dispatch 2024-01-21T07:39:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:25 smithi195 bash[13978]: audit 2024-01-21T07:39:24.864875+0000 mon.a (mon.0) 215 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e40c68c3-96c6-45e5-875a-cd0b65d215ff"}]': finished 2024-01-21T07:39:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:25 smithi195 bash[13978]: cluster 2024-01-21T07:39:24.864963+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-01-21T07:39:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:25 smithi195 bash[13978]: audit 2024-01-21T07:39:24.865262+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:27.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:26 smithi080 bash[17460]: cluster 2024-01-21T07:39:25.690970+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:27.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:26 smithi080 bash[13909]: cluster 2024-01-21T07:39:25.690970+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:27.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:26 smithi195 bash[13978]: cluster 2024-01-21T07:39:25.690970+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:28.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:27 smithi080 bash[13909]: audit 2024-01-21T07:39:26.973169+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.80:0/2967193707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:28.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:27 smithi080 bash[17460]: audit 2024-01-21T07:39:26.973169+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.80:0/2967193707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:27 smithi195 bash[13978]: audit 2024-01-21T07:39:26.973169+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.80:0/2967193707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:29.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:28 smithi080 bash[13909]: cluster 2024-01-21T07:39:27.691509+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:29.047 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:28 smithi080 bash[13909]: cluster 2024-01-21T07:39:28.674542+0000 mon.a (mon.0) 218 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-01-21T07:39:29.047 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:28 smithi080 bash[17460]: cluster 2024-01-21T07:39:27.691509+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:29.047 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:28 smithi080 bash[17460]: cluster 2024-01-21T07:39:28.674542+0000 mon.a (mon.0) 218 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-01-21T07:39:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:28 smithi195 bash[13978]: cluster 2024-01-21T07:39:27.691509+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:28 smithi195 bash[13978]: cluster 2024-01-21T07:39:28.674542+0000 mon.a (mon.0) 218 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-01-21T07:39:30.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:29 smithi080 bash[13909]: audit 2024-01-21T07:39:29.656169+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:30.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:29 smithi080 bash[17460]: audit 2024-01-21T07:39:29.656169+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:30.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:29 smithi195 bash[13978]: audit 2024-01-21T07:39:29.656169+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:30.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:30 smithi080 bash[13909]: cluster 2024-01-21T07:39:29.692055+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:30.889 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:30 smithi080 bash[17460]: cluster 2024-01-21T07:39:29.692055+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:31.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:30 smithi195 bash[13978]: cluster 2024-01-21T07:39:29.692055+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:32.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:31 smithi080 bash[13909]: cluster 2024-01-21T07:39:31.692739+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:32.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:31 smithi080 bash[17460]: cluster 2024-01-21T07:39:31.692739+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:32.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:31 smithi195 bash[13978]: cluster 2024-01-21T07:39:31.692739+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:33.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:33 smithi080 bash[13909]: audit 2024-01-21T07:39:33.122596+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-21T07:39:33.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:33 smithi080 bash[13909]: audit 2024-01-21T07:39:33.124542+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:33.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:33 smithi080 bash[13909]: audit 2024-01-21T07:39:33.126789+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-01-21T07:39:33.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:33 smithi080 bash[17460]: audit 2024-01-21T07:39:33.122596+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-21T07:39:33.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:33 smithi080 bash[17460]: audit 2024-01-21T07:39:33.124542+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:33.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:33 smithi080 bash[17460]: audit 2024-01-21T07:39:33.126789+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-01-21T07:39:33.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:33 smithi195 bash[13978]: audit 2024-01-21T07:39:33.122596+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-21T07:39:33.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:33 smithi195 bash[13978]: audit 2024-01-21T07:39:33.124542+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:33.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:33 smithi195 bash[13978]: audit 2024-01-21T07:39:33.126789+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-01-21T07:39:34.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:34 smithi080 bash[13909]: cephadm 2024-01-21T07:39:33.126095+0000 mgr.y (mgr.14140) 77 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-01-21T07:39:34.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:34 smithi080 bash[13909]: cluster 2024-01-21T07:39:33.693317+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:34.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:34 smithi080 bash[17460]: cephadm 2024-01-21T07:39:33.126095+0000 mgr.y (mgr.14140) 77 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-01-21T07:39:34.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:34 smithi080 bash[17460]: cluster 2024-01-21T07:39:33.693317+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:35.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:34 smithi195 bash[13978]: cephadm 2024-01-21T07:39:33.126095+0000 mgr.y (mgr.14140) 77 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-01-21T07:39:35.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:34 smithi195 bash[13978]: cluster 2024-01-21T07:39:33.693317+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:35.364 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 1 on host 'smithi080' 2024-01-21T07:39:36.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:35 smithi080 bash[13909]: audit 2024-01-21T07:39:35.355610+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:36.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:35 smithi080 bash[13909]: audit 2024-01-21T07:39:35.356225+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:36.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:35 smithi080 bash[13909]: audit 2024-01-21T07:39:35.360149+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:35 smithi080 bash[17460]: audit 2024-01-21T07:39:35.355610+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:35 smithi080 bash[17460]: audit 2024-01-21T07:39:35.356225+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:35 smithi080 bash[17460]: audit 2024-01-21T07:39:35.360149+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:36.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:35 smithi195 bash[13978]: audit 2024-01-21T07:39:35.355610+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:36.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:35 smithi195 bash[13978]: audit 2024-01-21T07:39:35.356225+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:36.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:35 smithi195 bash[13978]: audit 2024-01-21T07:39:35.360149+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927127\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927232\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927282\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:11.927330\", \"created\": \"2024-01-21T07:39:10.808174\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_device_update\": \"2024-01-21T07:39:19.543027\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:36.536 DEBUG:teuthology.orchestra.run.smithi080:osd.1> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.1.service 2024-01-21T07:39:36.538 INFO:tasks.cephadm:Deploying osd.2 on smithi080 with /dev/vg_nvme/lv_2... 2024-01-21T07:39:36.538 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-21T07:39:36.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[13909]: cluster 2024-01-21T07:39:35.693938+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:36.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[17460]: cluster 2024-01-21T07:39:35.693938+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:36.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[17460]: audit 2024-01-21T07:39:36.279116+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:36.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[17460]: audit 2024-01-21T07:39:36.284316+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:36.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[17460]: audit 2024-01-21T07:39:36.285404+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:36.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[13909]: audit 2024-01-21T07:39:36.279116+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:36.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[13909]: audit 2024-01-21T07:39:36.284316+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:36.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:36 smithi080 bash[13909]: audit 2024-01-21T07:39:36.285404+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:36 smithi195 bash[13978]: cluster 2024-01-21T07:39:35.693938+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:36 smithi195 bash[13978]: audit 2024-01-21T07:39:36.279116+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:36 smithi195 bash[13978]: audit 2024-01-21T07:39:36.284316+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:36 smithi195 bash[13978]: audit 2024-01-21T07:39:36.285404+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:37.161 INFO:journalctl@ceph.osd.1.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:39:38.058 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-21T07:39:38.058 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-01-21T07:39:38.058 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-01-21T07:39:38.059 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-01-21T07:39:38.059 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-01-21T07:39:38.059 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-21T07:39:38.059 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:37 smithi080 bash[20825]: --> ceph-volume lvm activate successful for osd ID: 1 2024-01-21T07:39:39.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:38 smithi080 bash[13909]: cluster 2024-01-21T07:39:37.694388+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:39.052 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:38 smithi080 bash[17460]: cluster 2024-01-21T07:39:37.694388+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:38 smithi195 bash[13978]: cluster 2024-01-21T07:39:37.694388+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:41.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:40 smithi080 bash[13909]: cluster 2024-01-21T07:39:39.694917+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:41.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:40 smithi080 bash[17460]: cluster 2024-01-21T07:39:39.694917+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:41.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:40 smithi195 bash[13978]: cluster 2024-01-21T07:39:39.694917+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:42.558 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:42 smithi080 bash[21083]: debug 2024-01-21T07:39:42.219+0000 7fb3585c7ec0 -1 Falling back to public interface 2024-01-21T07:39:42.738 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-21T07:39:42.738 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-21T07:39:42.739 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-01-21T07:39:42.739 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-01-21T07:39:42.739 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0148028 s, 708 MB/s 2024-01-21T07:39:42.739 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-01-21T07:39:43.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:42 smithi080 bash[13909]: cluster 2024-01-21T07:39:41.695452+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:43.058 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:42 smithi080 bash[21083]: debug 2024-01-21T07:39:42.867+0000 7fb3585c7ec0 -1 osd.1 0 log_to_monitors {default=true} 2024-01-21T07:39:43.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:42 smithi080 bash[17460]: cluster 2024-01-21T07:39:41.695452+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:43.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:42 smithi195 bash[13978]: cluster 2024-01-21T07:39:41.695452+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:43.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-01-21T07:39:44.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:43 smithi080 bash[13909]: audit 2024-01-21T07:39:42.876907+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-21T07:39:44.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:43 smithi080 bash[13909]: audit 2024-01-21T07:39:42.877339+0000 mon.a (mon.0) 229 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-21T07:39:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:43 smithi080 bash[17460]: audit 2024-01-21T07:39:42.876907+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-21T07:39:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:43 smithi080 bash[17460]: audit 2024-01-21T07:39:42.877339+0000 mon.a (mon.0) 229 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-21T07:39:44.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:43 smithi195 bash[13978]: audit 2024-01-21T07:39:42.876907+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-21T07:39:44.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:43 smithi195 bash[13978]: audit 2024-01-21T07:39:42.877339+0000 mon.a (mon.0) 229 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-21T07:39:44.988 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[21083]: debug 2024-01-21T07:39:44.739+0000 7fb33d374700 -1 osd.1 0 waiting for initial osdmap 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: cluster 2024-01-21T07:39:43.696000+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: audit 2024-01-21T07:39:43.738277+0000 mon.a (mon.0) 230 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: cluster 2024-01-21T07:39:43.738381+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: audit 2024-01-21T07:39:43.738700+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: audit 2024-01-21T07:39:43.740815+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: audit 2024-01-21T07:39:43.741480+0000 mon.a (mon.0) 233 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: cluster 2024-01-21T07:39:43.857244+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[13909]: cluster 2024-01-21T07:39:43.857332+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:39:44.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: cluster 2024-01-21T07:39:43.696000+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: audit 2024-01-21T07:39:43.738277+0000 mon.a (mon.0) 230 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: cluster 2024-01-21T07:39:43.738381+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: audit 2024-01-21T07:39:43.738700+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: audit 2024-01-21T07:39:43.740815+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: audit 2024-01-21T07:39:43.741480+0000 mon.a (mon.0) 233 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: cluster 2024-01-21T07:39:43.857244+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:39:44.990 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:44 smithi080 bash[17460]: cluster 2024-01-21T07:39:43.857332+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:39:45.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: cluster 2024-01-21T07:39:43.696000+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:45.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: audit 2024-01-21T07:39:43.738277+0000 mon.a (mon.0) 230 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-21T07:39:45.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: cluster 2024-01-21T07:39:43.738381+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-01-21T07:39:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: audit 2024-01-21T07:39:43.738700+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: audit 2024-01-21T07:39:43.740815+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: audit 2024-01-21T07:39:43.741480+0000 mon.a (mon.0) 233 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:39:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: cluster 2024-01-21T07:39:43.857244+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:39:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:44 smithi195 bash[13978]: cluster 2024-01-21T07:39:43.857332+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:39:46.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: audit 2024-01-21T07:39:44.741028+0000 mon.a (mon.0) 234 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:39:46.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: cluster 2024-01-21T07:39:44.741105+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-01-21T07:39:46.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: audit 2024-01-21T07:39:44.741305+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:46.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: audit 2024-01-21T07:39:44.835946+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: audit 2024-01-21T07:39:44.741028+0000 mon.a (mon.0) 234 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: cluster 2024-01-21T07:39:44.741105+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: audit 2024-01-21T07:39:44.741305+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: audit 2024-01-21T07:39:44.835946+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: audit 2024-01-21T07:39:45.067835+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: audit 2024-01-21T07:39:45.074041+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[13909]: cluster 2024-01-21T07:39:45.696574+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: audit 2024-01-21T07:39:45.067835+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: audit 2024-01-21T07:39:45.074041+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:46.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:45 smithi080 bash[17460]: cluster 2024-01-21T07:39:45.696574+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:46.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: audit 2024-01-21T07:39:44.741028+0000 mon.a (mon.0) 234 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:39:46.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: cluster 2024-01-21T07:39:44.741105+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-01-21T07:39:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: audit 2024-01-21T07:39:44.741305+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: audit 2024-01-21T07:39:44.835946+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:39:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: audit 2024-01-21T07:39:45.067835+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:39:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: audit 2024-01-21T07:39:45.074041+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}}, \"last_daemon_update\": \"2024-01-21T07:39:36.277650\", \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:39:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:45 smithi195 bash[13978]: cluster 2024-01-21T07:39:45.696574+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-01-21T07:39:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:46 smithi080 bash[13909]: cluster 2024-01-21T07:39:45.746093+0000 mon.a (mon.0) 240 : cluster [INF] osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317] boot 2024-01-21T07:39:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:46 smithi080 bash[13909]: cluster 2024-01-21T07:39:45.746225+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-01-21T07:39:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:46 smithi080 bash[13909]: audit 2024-01-21T07:39:45.747267+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:47.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:46 smithi080 bash[17460]: cluster 2024-01-21T07:39:45.746093+0000 mon.a (mon.0) 240 : cluster [INF] osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317] boot 2024-01-21T07:39:47.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:46 smithi080 bash[17460]: cluster 2024-01-21T07:39:45.746225+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-01-21T07:39:47.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:46 smithi080 bash[17460]: audit 2024-01-21T07:39:45.747267+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:47.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:46 smithi195 bash[13978]: cluster 2024-01-21T07:39:45.746093+0000 mon.a (mon.0) 240 : cluster [INF] osd.1 [v2:172.21.15.80:6810/4131031317,v1:172.21.15.80:6811/4131031317] boot 2024-01-21T07:39:47.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:46 smithi195 bash[13978]: cluster 2024-01-21T07:39:45.746225+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-01-21T07:39:47.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:46 smithi195 bash[13978]: audit 2024-01-21T07:39:45.747267+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:39:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: cluster 2024-01-21T07:39:46.764373+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-01-21T07:39:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: audit 2024-01-21T07:39:46.881764+0000 mgr.y (mgr.14140) 85 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:39:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: cephadm 2024-01-21T07:39:46.882600+0000 mgr.y (mgr.14140) 86 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: audit 2024-01-21T07:39:46.883069+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: audit 2024-01-21T07:39:46.884577+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: audit 2024-01-21T07:39:46.886316+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: audit 2024-01-21T07:39:46.983814+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240121-073719"}]: dispatch 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: audit 2024-01-21T07:39:46.989500+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240121-073719"}]': finished 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[13909]: cluster 2024-01-21T07:39:47.697169+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: cluster 2024-01-21T07:39:46.764373+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: audit 2024-01-21T07:39:46.881764+0000 mgr.y (mgr.14140) 85 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: cephadm 2024-01-21T07:39:46.882600+0000 mgr.y (mgr.14140) 86 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: audit 2024-01-21T07:39:46.883069+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:39:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: audit 2024-01-21T07:39:46.884577+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:48.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: audit 2024-01-21T07:39:46.886316+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:48.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: audit 2024-01-21T07:39:46.983814+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240121-073719"}]: dispatch 2024-01-21T07:39:48.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: audit 2024-01-21T07:39:46.989500+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240121-073719"}]': finished 2024-01-21T07:39:48.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:47 smithi080 bash[17460]: cluster 2024-01-21T07:39:47.697169+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-01-21T07:39:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: cluster 2024-01-21T07:39:46.764373+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-01-21T07:39:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: audit 2024-01-21T07:39:46.881764+0000 mgr.y (mgr.14140) 85 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:39:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: cephadm 2024-01-21T07:39:46.882600+0000 mgr.y (mgr.14140) 86 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:39:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: audit 2024-01-21T07:39:46.883069+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:39:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: audit 2024-01-21T07:39:46.884577+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:39:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: audit 2024-01-21T07:39:46.886316+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: audit 2024-01-21T07:39:46.983814+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240121-073719"}]: dispatch 2024-01-21T07:39:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: audit 2024-01-21T07:39:46.989500+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240121-073719"}]': finished 2024-01-21T07:39:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:47 smithi195 bash[13978]: cluster 2024-01-21T07:39:47.697169+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-01-21T07:39:50.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:49 smithi080 bash[13909]: cluster 2024-01-21T07:39:49.697744+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-01-21T07:39:50.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:49 smithi080 bash[17460]: cluster 2024-01-21T07:39:49.697744+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-01-21T07:39:50.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:49 smithi195 bash[13978]: cluster 2024-01-21T07:39:49.697744+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-01-21T07:39:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[17460]: audit 2024-01-21T07:39:50.222306+0000 mon.a (mon.0) 249 : audit [INF] from='client.? 172.21.15.80:0/233291277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8761092d-c3ee-4a24-9d86-39182ffb54e3"}]: dispatch 2024-01-21T07:39:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[17460]: audit 2024-01-21T07:39:50.227660+0000 mon.a (mon.0) 250 : audit [INF] from='client.? 172.21.15.80:0/233291277' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8761092d-c3ee-4a24-9d86-39182ffb54e3"}]': finished 2024-01-21T07:39:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[17460]: cluster 2024-01-21T07:39:50.227697+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-01-21T07:39:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[17460]: audit 2024-01-21T07:39:50.227928+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:39:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[13909]: audit 2024-01-21T07:39:50.222306+0000 mon.a (mon.0) 249 : audit [INF] from='client.? 172.21.15.80:0/233291277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8761092d-c3ee-4a24-9d86-39182ffb54e3"}]: dispatch 2024-01-21T07:39:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[13909]: audit 2024-01-21T07:39:50.227660+0000 mon.a (mon.0) 250 : audit [INF] from='client.? 172.21.15.80:0/233291277' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8761092d-c3ee-4a24-9d86-39182ffb54e3"}]': finished 2024-01-21T07:39:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[13909]: cluster 2024-01-21T07:39:50.227697+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-01-21T07:39:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:50 smithi080 bash[13909]: audit 2024-01-21T07:39:50.227928+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:39:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:50 smithi195 bash[13978]: audit 2024-01-21T07:39:50.222306+0000 mon.a (mon.0) 249 : audit [INF] from='client.? 172.21.15.80:0/233291277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8761092d-c3ee-4a24-9d86-39182ffb54e3"}]: dispatch 2024-01-21T07:39:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:50 smithi195 bash[13978]: audit 2024-01-21T07:39:50.227660+0000 mon.a (mon.0) 250 : audit [INF] from='client.? 172.21.15.80:0/233291277' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8761092d-c3ee-4a24-9d86-39182ffb54e3"}]': finished 2024-01-21T07:39:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:50 smithi195 bash[13978]: cluster 2024-01-21T07:39:50.227697+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-01-21T07:39:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:50 smithi195 bash[13978]: audit 2024-01-21T07:39:50.227928+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:39:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:51 smithi080 bash[13909]: cluster 2024-01-21T07:39:51.698463+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:52.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:51 smithi080 bash[17460]: cluster 2024-01-21T07:39:51.698463+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:52.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:51 smithi195 bash[13978]: cluster 2024-01-21T07:39:51.698463+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:53.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:52 smithi080 bash[17460]: cluster 2024-01-21T07:39:51.786793+0000 mon.a (mon.0) 253 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-01-21T07:39:53.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:52 smithi080 bash[17460]: cluster 2024-01-21T07:39:51.786861+0000 mon.a (mon.0) 254 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-01-21T07:39:53.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:52 smithi080 bash[17460]: audit 2024-01-21T07:39:52.376359+0000 mon.a (mon.0) 255 : audit [DBG] from='client.? 172.21.15.80:0/1080138143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:53.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:52 smithi080 bash[13909]: cluster 2024-01-21T07:39:51.786793+0000 mon.a (mon.0) 253 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-01-21T07:39:53.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:52 smithi080 bash[13909]: cluster 2024-01-21T07:39:51.786861+0000 mon.a (mon.0) 254 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-01-21T07:39:53.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:52 smithi080 bash[13909]: audit 2024-01-21T07:39:52.376359+0000 mon.a (mon.0) 255 : audit [DBG] from='client.? 172.21.15.80:0/1080138143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:52 smithi195 bash[13978]: cluster 2024-01-21T07:39:51.786793+0000 mon.a (mon.0) 253 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-01-21T07:39:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:52 smithi195 bash[13978]: cluster 2024-01-21T07:39:51.786861+0000 mon.a (mon.0) 254 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-01-21T07:39:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:52 smithi195 bash[13978]: audit 2024-01-21T07:39:52.376359+0000 mon.a (mon.0) 255 : audit [DBG] from='client.? 172.21.15.80:0/1080138143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:39:54.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:54 smithi080 bash[13909]: cluster 2024-01-21T07:39:53.699055+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:54.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:54 smithi080 bash[17460]: cluster 2024-01-21T07:39:53.699055+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:55.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:54 smithi195 bash[13978]: cluster 2024-01-21T07:39:53.699055+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:55 smithi080 bash[13909]: audit 2024-01-21T07:39:55.134367+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:56.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:55 smithi080 bash[17460]: audit 2024-01-21T07:39:55.134367+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:55 smithi195 bash[13978]: audit 2024-01-21T07:39:55.134367+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:39:57.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:56 smithi080 bash[13909]: cluster 2024-01-21T07:39:55.699631+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:57.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:56 smithi080 bash[17460]: cluster 2024-01-21T07:39:55.699631+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:56 smithi195 bash[13978]: cluster 2024-01-21T07:39:55.699631+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:59.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:58 smithi080 bash[13909]: cluster 2024-01-21T07:39:57.700254+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:59.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:58 smithi080 bash[17460]: cluster 2024-01-21T07:39:57.700254+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:39:59.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:58 smithi195 bash[13978]: cluster 2024-01-21T07:39:57.700254+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:00.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:59 smithi080 bash[13909]: audit 2024-01-21T07:39:58.839277+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-21T07:40:00.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:59 smithi080 bash[13909]: audit 2024-01-21T07:39:58.841070+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:00.038 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:39:59 smithi080 bash[13909]: audit 2024-01-21T07:39:58.843237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-01-21T07:40:00.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:59 smithi080 bash[17460]: audit 2024-01-21T07:39:58.839277+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-21T07:40:00.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:59 smithi080 bash[17460]: audit 2024-01-21T07:39:58.841070+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:00.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:39:59 smithi080 bash[17460]: audit 2024-01-21T07:39:58.843237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-01-21T07:40:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:59 smithi195 bash[13978]: audit 2024-01-21T07:39:58.839277+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-21T07:40:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:59 smithi195 bash[13978]: audit 2024-01-21T07:39:58.841070+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:39:59 smithi195 bash[13978]: audit 2024-01-21T07:39:58.843237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-01-21T07:40:00.860 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:00 smithi080 bash[13909]: cephadm 2024-01-21T07:39:58.842475+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-01-21T07:40:00.861 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:00 smithi080 bash[13909]: cluster 2024-01-21T07:39:59.700888+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:00.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:00 smithi080 bash[17460]: cephadm 2024-01-21T07:39:58.842475+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-01-21T07:40:00.861 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:00 smithi080 bash[17460]: cluster 2024-01-21T07:39:59.700888+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:01.127 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 2 on host 'smithi080' 2024-01-21T07:40:01.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:00 smithi195 bash[13978]: cephadm 2024-01-21T07:39:58.842475+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-01-21T07:40:01.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:00 smithi195 bash[13978]: cluster 2024-01-21T07:39:59.700888+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:02.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:01 smithi080 bash[17460]: audit 2024-01-21T07:40:01.117602+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:02.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:01 smithi080 bash[17460]: audit 2024-01-21T07:40:01.118248+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:02.123 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:01 smithi080 bash[17460]: audit 2024-01-21T07:40:01.121601+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:02.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:01 smithi080 bash[13909]: audit 2024-01-21T07:40:01.117602+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:02.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:01 smithi080 bash[13909]: audit 2024-01-21T07:40:01.118248+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:02.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:01 smithi080 bash[13909]: audit 2024-01-21T07:40:01.121601+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:02.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:01 smithi195 bash[13978]: audit 2024-01-21T07:40:01.117602+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:02.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:01 smithi195 bash[13978]: audit 2024-01-21T07:40:01.118248+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:02.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:01 smithi195 bash[13978]: audit 2024-01-21T07:40:01.121601+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277001\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277176\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277280\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277378\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:39:36.277475\", \"created\": \"2024-01-21T07:39:35.335977\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_device_update\": \"2024-01-21T07:39:45.066121\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:02.666 DEBUG:teuthology.orchestra.run.smithi080:osd.2> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.2.service 2024-01-21T07:40:02.668 INFO:tasks.cephadm:Deploying osd.3 on smithi080 with /dev/vg_nvme/lv_1... 2024-01-21T07:40:02.668 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-21T07:40:03.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[13909]: cluster 2024-01-21T07:40:01.701471+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v87: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:03.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[17460]: cluster 2024-01-21T07:40:01.701471+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v87: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[13909]: audit 2024-01-21T07:40:02.324047+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[13909]: audit 2024-01-21T07:40:02.330069+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:03.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[13909]: audit 2024-01-21T07:40:02.331455+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[17460]: audit 2024-01-21T07:40:02.324047+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[17460]: audit 2024-01-21T07:40:02.330069+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:02 smithi080 bash[17460]: audit 2024-01-21T07:40:02.331455+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:03.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:02 smithi195 bash[13978]: cluster 2024-01-21T07:40:01.701471+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v87: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:03.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:02 smithi195 bash[13978]: audit 2024-01-21T07:40:02.324047+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:03.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:02 smithi195 bash[13978]: audit 2024-01-21T07:40:02.330069+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:03.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:02 smithi195 bash[13978]: audit 2024-01-21T07:40:02.331455+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-21T07:40:04.450 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:03 smithi080 bash[22423]: --> ceph-volume lvm activate successful for osd ID: 2 2024-01-21T07:40:04.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:04 smithi080 bash[13909]: cluster 2024-01-21T07:40:03.702018+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:04.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:04 smithi080 bash[17460]: cluster 2024-01-21T07:40:03.702018+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:05.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:04 smithi195 bash[13978]: cluster 2024-01-21T07:40:03.702018+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:05 smithi080 bash[13909]: cluster 2024-01-21T07:40:05.702666+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:06.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:05 smithi080 bash[17460]: cluster 2024-01-21T07:40:05.702666+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:05 smithi195 bash[13978]: cluster 2024-01-21T07:40:05.702666+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:08.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:07 smithi080 bash[13909]: cluster 2024-01-21T07:40:07.703244+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:08.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:07 smithi080 bash[17460]: cluster 2024-01-21T07:40:07.703244+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:08.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:07 smithi195 bash[13978]: cluster 2024-01-21T07:40:07.703244+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:08.558 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:08 smithi080 bash[22672]: debug 2024-01-21T07:40:08.179+0000 7f5950da2ec0 -1 Falling back to public interface 2024-01-21T07:40:09.058 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:08 smithi080 bash[22672]: debug 2024-01-21T07:40:08.787+0000 7f5950da2ec0 -1 osd.2 0 log_to_monitors {default=true} 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0201983 s, 519 MB/s 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 2024-01-21T07:40:09.416 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-01-21T07:40:09.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:09 smithi080 bash[13909]: audit 2024-01-21T07:40:08.794740+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-21T07:40:09.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:09 smithi080 bash[13909]: audit 2024-01-21T07:40:08.795149+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-21T07:40:09.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:09 smithi080 bash[17460]: audit 2024-01-21T07:40:08.794740+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-21T07:40:09.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:09 smithi080 bash[17460]: audit 2024-01-21T07:40:08.795149+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-21T07:40:10.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-01-21T07:40:10.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:09 smithi195 bash[13978]: audit 2024-01-21T07:40:08.794740+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-21T07:40:10.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:09 smithi195 bash[13978]: audit 2024-01-21T07:40:08.795149+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-21T07:40:10.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: audit 2024-01-21T07:40:09.702341+0000 mon.a (mon.0) 267 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-21T07:40:10.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: cluster 2024-01-21T07:40:09.702428+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-01-21T07:40:10.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: audit 2024-01-21T07:40:09.702613+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:10.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: cluster 2024-01-21T07:40:09.703764+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: audit 2024-01-21T07:40:09.704755+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: audit 2024-01-21T07:40:09.705247+0000 mon.a (mon.0) 270 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: cluster 2024-01-21T07:40:09.754730+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[13909]: cluster 2024-01-21T07:40:09.754812+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: audit 2024-01-21T07:40:09.702341+0000 mon.a (mon.0) 267 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: cluster 2024-01-21T07:40:09.702428+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: audit 2024-01-21T07:40:09.702613+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: cluster 2024-01-21T07:40:09.703764+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: audit 2024-01-21T07:40:09.704755+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: audit 2024-01-21T07:40:09.705247+0000 mon.a (mon.0) 270 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:10.991 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: cluster 2024-01-21T07:40:09.754730+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:10.992 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[17460]: cluster 2024-01-21T07:40:09.754812+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:10.992 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:40:10 smithi080 bash[22672]: debug 2024-01-21T07:40:10.707+0000 7f5939b57700 -1 osd.2 0 waiting for initial osdmap 2024-01-21T07:40:11.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: audit 2024-01-21T07:40:09.702341+0000 mon.a (mon.0) 267 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: cluster 2024-01-21T07:40:09.702428+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: audit 2024-01-21T07:40:09.702613+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: cluster 2024-01-21T07:40:09.703764+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: audit 2024-01-21T07:40:09.704755+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: audit 2024-01-21T07:40:09.705247+0000 mon.a (mon.0) 270 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: cluster 2024-01-21T07:40:09.754730+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:10 smithi195 bash[13978]: cluster 2024-01-21T07:40:09.754812+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:12.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[13909]: audit 2024-01-21T07:40:10.707378+0000 mon.a (mon.0) 271 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[13909]: cluster 2024-01-21T07:40:10.707579+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[13909]: audit 2024-01-21T07:40:10.708849+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[13909]: audit 2024-01-21T07:40:11.642690+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[17460]: audit 2024-01-21T07:40:10.707378+0000 mon.a (mon.0) 271 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[17460]: cluster 2024-01-21T07:40:10.707579+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[17460]: audit 2024-01-21T07:40:10.708849+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:12.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:11 smithi080 bash[17460]: audit 2024-01-21T07:40:11.642690+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:12.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:11 smithi195 bash[13978]: audit 2024-01-21T07:40:10.707378+0000 mon.a (mon.0) 271 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:40:12.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:11 smithi195 bash[13978]: cluster 2024-01-21T07:40:10.707579+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-01-21T07:40:12.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:11 smithi195 bash[13978]: audit 2024-01-21T07:40:10.708849+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:12.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:11 smithi195 bash[13978]: audit 2024-01-21T07:40:11.642690+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:12.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[13909]: cluster 2024-01-21T07:40:11.704333+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[13909]: cluster 2024-01-21T07:40:11.719256+0000 mon.a (mon.0) 275 : cluster [INF] osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868] boot 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[13909]: cluster 2024-01-21T07:40:11.719344+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[13909]: audit 2024-01-21T07:40:11.720388+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[17460]: cluster 2024-01-21T07:40:11.704333+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[17460]: cluster 2024-01-21T07:40:11.719256+0000 mon.a (mon.0) 275 : cluster [INF] osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868] boot 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[17460]: cluster 2024-01-21T07:40:11.719344+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-01-21T07:40:12.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[17460]: audit 2024-01-21T07:40:11.720388+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:12.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[13909]: audit 2024-01-21T07:40:11.876343+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:12.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[13909]: audit 2024-01-21T07:40:11.880604+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:12.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[17460]: audit 2024-01-21T07:40:11.876343+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:12.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:12 smithi080 bash[17460]: audit 2024-01-21T07:40:11.880604+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:13.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:12 smithi195 bash[13978]: cluster 2024-01-21T07:40:11.704333+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:13.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:12 smithi195 bash[13978]: cluster 2024-01-21T07:40:11.719256+0000 mon.a (mon.0) 275 : cluster [INF] osd.2 [v2:172.21.15.80:6818/1036175868,v1:172.21.15.80:6819/1036175868] boot 2024-01-21T07:40:13.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:12 smithi195 bash[13978]: cluster 2024-01-21T07:40:11.719344+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-01-21T07:40:13.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:12 smithi195 bash[13978]: audit 2024-01-21T07:40:11.720388+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:40:13.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:12 smithi195 bash[13978]: audit 2024-01-21T07:40:11.876343+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:13.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:12 smithi195 bash[13978]: audit 2024-01-21T07:40:11.880604+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}}, \"last_daemon_update\": \"2024-01-21T07:40:02.323029\", \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:14.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: cluster 2024-01-21T07:40:12.730771+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-01-21T07:40:14.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: audit 2024-01-21T07:40:13.559451+0000 mgr.y (mgr.14140) 101 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:40:14.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: cephadm 2024-01-21T07:40:13.560822+0000 mgr.y (mgr.14140) 102 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: audit 2024-01-21T07:40:13.561403+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: audit 2024-01-21T07:40:13.563098+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: audit 2024-01-21T07:40:13.565406+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: cluster 2024-01-21T07:40:13.704788+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[13909]: cluster 2024-01-21T07:40:13.732280+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: cluster 2024-01-21T07:40:12.730771+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: audit 2024-01-21T07:40:13.559451+0000 mgr.y (mgr.14140) 101 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: cephadm 2024-01-21T07:40:13.560822+0000 mgr.y (mgr.14140) 102 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:40:14.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: audit 2024-01-21T07:40:13.561403+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:40:14.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: audit 2024-01-21T07:40:13.563098+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:14.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: audit 2024-01-21T07:40:13.565406+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:14.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: cluster 2024-01-21T07:40:13.704788+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:14.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:13 smithi080 bash[17460]: cluster 2024-01-21T07:40:13.732280+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: cluster 2024-01-21T07:40:12.730771+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: audit 2024-01-21T07:40:13.559451+0000 mgr.y (mgr.14140) 101 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: cephadm 2024-01-21T07:40:13.560822+0000 mgr.y (mgr.14140) 102 : cephadm [INF] Applying osd on host smithi080... 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: audit 2024-01-21T07:40:13.561403+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: audit 2024-01-21T07:40:13.563098+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: audit 2024-01-21T07:40:13.565406+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: cluster 2024-01-21T07:40:13.704788+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:14.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:13 smithi195 bash[13978]: cluster 2024-01-21T07:40:13.732280+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-01-21T07:40:16.051 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:15 smithi080 bash[13909]: cluster 2024-01-21T07:40:15.705372+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized+degraded; 0 B data, 552 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:16.052 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:15 smithi080 bash[17460]: cluster 2024-01-21T07:40:15.705372+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized+degraded; 0 B data, 552 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:16.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:15 smithi195 bash[13978]: cluster 2024-01-21T07:40:15.705372+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized+degraded; 0 B data, 552 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-01-21T07:40:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[13909]: audit 2024-01-21T07:40:16.836922+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.80:0/3094981708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]: dispatch 2024-01-21T07:40:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[13909]: audit 2024-01-21T07:40:16.837507+0000 mon.a (mon.0) 285 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]: dispatch 2024-01-21T07:40:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[13909]: audit 2024-01-21T07:40:16.843950+0000 mon.a (mon.0) 286 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]': finished 2024-01-21T07:40:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[13909]: cluster 2024-01-21T07:40:16.844014+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-01-21T07:40:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[13909]: audit 2024-01-21T07:40:16.844206+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:17.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[17460]: audit 2024-01-21T07:40:16.836922+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.80:0/3094981708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]: dispatch 2024-01-21T07:40:17.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[17460]: audit 2024-01-21T07:40:16.837507+0000 mon.a (mon.0) 285 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]: dispatch 2024-01-21T07:40:17.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[17460]: audit 2024-01-21T07:40:16.843950+0000 mon.a (mon.0) 286 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]': finished 2024-01-21T07:40:17.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[17460]: cluster 2024-01-21T07:40:16.844014+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-01-21T07:40:17.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:16 smithi080 bash[17460]: audit 2024-01-21T07:40:16.844206+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:17.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:16 smithi195 bash[13978]: audit 2024-01-21T07:40:16.836922+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.80:0/3094981708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]: dispatch 2024-01-21T07:40:17.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:16 smithi195 bash[13978]: audit 2024-01-21T07:40:16.837507+0000 mon.a (mon.0) 285 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]: dispatch 2024-01-21T07:40:17.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:16 smithi195 bash[13978]: audit 2024-01-21T07:40:16.843950+0000 mon.a (mon.0) 286 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1daf8576-7e1e-44cc-8477-c8108442dd40"}]': finished 2024-01-21T07:40:17.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:16 smithi195 bash[13978]: cluster 2024-01-21T07:40:16.844014+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-01-21T07:40:17.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:16 smithi195 bash[13978]: audit 2024-01-21T07:40:16.844206+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:18.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:17 smithi080 bash[13909]: cluster 2024-01-21T07:40:17.705969+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:18.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:17 smithi080 bash[17460]: cluster 2024-01-21T07:40:17.705969+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:18.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:17 smithi195 bash[13978]: cluster 2024-01-21T07:40:17.705969+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:19.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:18 smithi080 bash[13909]: cluster 2024-01-21T07:40:17.892785+0000 mon.a (mon.0) 289 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-01-21T07:40:19.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:18 smithi080 bash[13909]: cluster 2024-01-21T07:40:17.892862+0000 mon.a (mon.0) 290 : cluster [INF] Cluster is now healthy 2024-01-21T07:40:19.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:18 smithi080 bash[17460]: cluster 2024-01-21T07:40:17.892785+0000 mon.a (mon.0) 289 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-01-21T07:40:19.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:18 smithi080 bash[17460]: cluster 2024-01-21T07:40:17.892862+0000 mon.a (mon.0) 290 : cluster [INF] Cluster is now healthy 2024-01-21T07:40:19.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:18 smithi195 bash[13978]: cluster 2024-01-21T07:40:17.892785+0000 mon.a (mon.0) 289 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-01-21T07:40:19.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:18 smithi195 bash[13978]: cluster 2024-01-21T07:40:17.892862+0000 mon.a (mon.0) 290 : cluster [INF] Cluster is now healthy 2024-01-21T07:40:20.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:19 smithi080 bash[13909]: audit 2024-01-21T07:40:19.201216+0000 mon.a (mon.0) 291 : audit [DBG] from='client.? 172.21.15.80:0/2882251084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:40:20.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:19 smithi080 bash[13909]: cluster 2024-01-21T07:40:19.706577+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 596 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:19 smithi080 bash[17460]: audit 2024-01-21T07:40:19.201216+0000 mon.a (mon.0) 291 : audit [DBG] from='client.? 172.21.15.80:0/2882251084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:40:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:19 smithi080 bash[17460]: cluster 2024-01-21T07:40:19.706577+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 596 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:20.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:19 smithi195 bash[13978]: audit 2024-01-21T07:40:19.201216+0000 mon.a (mon.0) 291 : audit [DBG] from='client.? 172.21.15.80:0/2882251084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:40:20.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:19 smithi195 bash[13978]: cluster 2024-01-21T07:40:19.706577+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 596 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:22.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:21 smithi080 bash[17460]: cluster 2024-01-21T07:40:21.707085+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 612 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:22.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:21 smithi080 bash[13909]: cluster 2024-01-21T07:40:21.707085+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 612 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:22.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:21 smithi195 bash[13978]: cluster 2024-01-21T07:40:21.707085+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 612 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:23.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:22 smithi080 bash[13909]: audit 2024-01-21T07:40:22.115761+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:23.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:22 smithi080 bash[17460]: audit 2024-01-21T07:40:22.115761+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:23.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:22 smithi195 bash[13978]: audit 2024-01-21T07:40:22.115761+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:25.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:24 smithi080 bash[13909]: cluster 2024-01-21T07:40:23.707628+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:25.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:24 smithi080 bash[17460]: cluster 2024-01-21T07:40:23.707628+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:25.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:24 smithi195 bash[13978]: cluster 2024-01-21T07:40:23.707628+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:25 smithi080 bash[13909]: cluster 2024-01-21T07:40:25.708245+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:26.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:25 smithi080 bash[17460]: cluster 2024-01-21T07:40:25.708245+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:26.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:25 smithi195 bash[13978]: cluster 2024-01-21T07:40:25.708245+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:40:27.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[13909]: audit 2024-01-21T07:40:25.930723+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-21T07:40:27.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[13909]: audit 2024-01-21T07:40:25.932326+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:27.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[13909]: cephadm 2024-01-21T07:40:25.933610+0000 mgr.y (mgr.14140) 110 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-01-21T07:40:27.044 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[13909]: audit 2024-01-21T07:40:25.934193+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-01-21T07:40:27.045 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[17460]: audit 2024-01-21T07:40:25.930723+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-21T07:40:27.045 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[17460]: audit 2024-01-21T07:40:25.932326+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:27.045 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[17460]: cephadm 2024-01-21T07:40:25.933610+0000 mgr.y (mgr.14140) 110 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-01-21T07:40:27.045 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:26 smithi080 bash[17460]: audit 2024-01-21T07:40:25.934193+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-01-21T07:40:27.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:26 smithi195 bash[13978]: audit 2024-01-21T07:40:25.930723+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-21T07:40:27.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:26 smithi195 bash[13978]: audit 2024-01-21T07:40:25.932326+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:27.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:26 smithi195 bash[13978]: cephadm 2024-01-21T07:40:25.933610+0000 mgr.y (mgr.14140) 110 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-01-21T07:40:27.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:26 smithi195 bash[13978]: audit 2024-01-21T07:40:25.934193+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-01-21T07:40:28.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:27 smithi080 bash[13909]: cluster 2024-01-21T07:40:27.708910+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:28.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:27 smithi080 bash[17460]: cluster 2024-01-21T07:40:27.708910+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:28.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:27 smithi195 bash[13978]: cluster 2024-01-21T07:40:27.708910+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:28.179 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 3 on host 'smithi080' 2024-01-21T07:40:28.925 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:28 smithi080 bash[17460]: audit 2024-01-21T07:40:28.168386+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:28.925 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:28 smithi080 bash[17460]: audit 2024-01-21T07:40:28.169151+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:28.925 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:28 smithi080 bash[17460]: audit 2024-01-21T07:40:28.173353+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:28.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:28 smithi080 bash[13909]: audit 2024-01-21T07:40:28.168386+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:28.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:28 smithi080 bash[13909]: audit 2024-01-21T07:40:28.169151+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:28.926 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:28 smithi080 bash[13909]: audit 2024-01-21T07:40:28.173353+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:28 smithi195 bash[13978]: audit 2024-01-21T07:40:28.168386+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:28 smithi195 bash[13978]: audit 2024-01-21T07:40:28.169151+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:29.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:28 smithi195 bash[13978]: audit 2024-01-21T07:40:28.173353+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322131\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322334\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322459\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322603\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322728\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:02.322849\", \"created\": \"2024-01-21T07:40:01.095668\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_device_update\": \"2024-01-21T07:40:11.874686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:29.917 DEBUG:teuthology.orchestra.run.smithi080:osd.3> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.3.service 2024-01-21T07:40:29.919 INFO:tasks.cephadm:Deploying osd.4 on smithi195 with /dev/vg_nvme/lv_4... 2024-01-21T07:40:29.919 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-21T07:40:30.154 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:29 smithi195 bash[13978]: audit 2024-01-21T07:40:29.042630+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:30.154 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:29 smithi195 bash[13978]: audit 2024-01-21T07:40:29.048599+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:30.154 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:29 smithi195 bash[13978]: audit 2024-01-21T07:40:29.049729+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:30.154 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:29 smithi195 bash[13978]: cluster 2024-01-21T07:40:29.709591+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:30.191 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[13909]: audit 2024-01-21T07:40:29.042630+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[17460]: audit 2024-01-21T07:40:29.042630+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[17460]: audit 2024-01-21T07:40:29.048599+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[17460]: audit 2024-01-21T07:40:29.049729+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[17460]: cluster 2024-01-21T07:40:29.709591+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[13909]: audit 2024-01-21T07:40:29.048599+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[13909]: audit 2024-01-21T07:40:29.049729+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:30.192 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:29 smithi080 bash[13909]: cluster 2024-01-21T07:40:29.709591+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:30.388 INFO:journalctl@ceph.osd.3.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-21T07:40:30.826 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:30 smithi080 bash[24033]: --> ceph-volume lvm activate successful for osd ID: 3 2024-01-21T07:40:31.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:31 smithi195 bash[13978]: cluster 2024-01-21T07:40:31.710180+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:32.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:31 smithi080 bash[13909]: cluster 2024-01-21T07:40:31.710180+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:32.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:31 smithi080 bash[17460]: cluster 2024-01-21T07:40:31.710180+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0186362 s, 563 MB/s 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 2024-01-21T07:40:32.714 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-01-21T07:40:33.308 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:33 smithi080 bash[24344]: debug 2024-01-21T07:40:33.075+0000 7f81888c4ec0 1 -- 172.21.15.80:0/3119836569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f2c5a4c00 msgr2=0x561f2c5a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T07:40:33.308 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:33 smithi080 bash[24344]: debug 2024-01-21T07:40:33.075+0000 7f81888c4ec0 1 --2- 172.21.15.80:0/3119836569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f2c5a4c00 0x561f2c5a1680 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x561f2c53bd10 tx=0x561f2d210aa0).stop 2024-01-21T07:40:33.348 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-01-21T07:40:34.058 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:33 smithi080 bash[24344]: debug 2024-01-21T07:40:33.623+0000 7f81888c4ec0 -1 Falling back to public interface 2024-01-21T07:40:34.558 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:34 smithi080 bash[24344]: debug 2024-01-21T07:40:34.291+0000 7f81888c4ec0 -1 osd.3 0 log_to_monitors {default=true} 2024-01-21T07:40:34.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:34 smithi080 bash[13909]: cluster 2024-01-21T07:40:33.710705+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:34.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:34 smithi080 bash[13909]: audit 2024-01-21T07:40:34.303771+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-21T07:40:34.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:34 smithi080 bash[17460]: cluster 2024-01-21T07:40:33.710705+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:34.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:34 smithi080 bash[17460]: audit 2024-01-21T07:40:34.303771+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-21T07:40:34.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:34 smithi195 bash[13978]: cluster 2024-01-21T07:40:33.710705+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 620 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:34.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:34 smithi195 bash[13978]: audit 2024-01-21T07:40:34.303771+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-21T07:40:35.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: audit 2024-01-21T07:40:34.710936+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-21T07:40:35.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: cluster 2024-01-21T07:40:34.710980+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: audit 2024-01-21T07:40:34.711193+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: audit 2024-01-21T07:40:34.711939+0000 mon.a (mon.0) 306 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: audit 2024-01-21T07:40:34.976404+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: audit 2024-01-21T07:40:35.203707+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: audit 2024-01-21T07:40:35.209679+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: cluster 2024-01-21T07:40:35.260114+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:35.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:35 smithi195 bash[13978]: cluster 2024-01-21T07:40:35.260185+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:36.058 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[24344]: debug 2024-01-21T07:40:35.714+0000 7f816d671700 -1 osd.3 0 waiting for initial osdmap 2024-01-21T07:40:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: audit 2024-01-21T07:40:34.710936+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-21T07:40:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: cluster 2024-01-21T07:40:34.710980+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-01-21T07:40:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: audit 2024-01-21T07:40:34.711193+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: audit 2024-01-21T07:40:34.711939+0000 mon.a (mon.0) 306 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:36.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: audit 2024-01-21T07:40:34.976404+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: audit 2024-01-21T07:40:34.710936+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-21T07:40:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: cluster 2024-01-21T07:40:34.710980+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-01-21T07:40:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: audit 2024-01-21T07:40:34.711193+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: audit 2024-01-21T07:40:34.711939+0000 mon.a (mon.0) 306 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:40:36.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: audit 2024-01-21T07:40:34.976404+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: audit 2024-01-21T07:40:35.203707+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: audit 2024-01-21T07:40:35.209679+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: cluster 2024-01-21T07:40:35.260114+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[13909]: cluster 2024-01-21T07:40:35.260185+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: audit 2024-01-21T07:40:35.203707+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: audit 2024-01-21T07:40:35.209679+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}}, \"last_daemon_update\": \"2024-01-21T07:40:29.040988\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:40:36.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: cluster 2024-01-21T07:40:35.260114+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:36.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:35 smithi080 bash[17460]: cluster 2024-01-21T07:40:35.260185+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: cluster 2024-01-21T07:40:35.711266+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 628 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: audit 2024-01-21T07:40:35.712995+0000 mon.a (mon.0) 310 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: cluster 2024-01-21T07:40:35.713100+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: audit 2024-01-21T07:40:35.714462+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: audit 2024-01-21T07:40:35.958909+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: audit 2024-01-21T07:40:35.960627+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[13909]: audit 2024-01-21T07:40:35.963083+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: cluster 2024-01-21T07:40:35.711266+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 628 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: audit 2024-01-21T07:40:35.712995+0000 mon.a (mon.0) 310 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: cluster 2024-01-21T07:40:35.713100+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: audit 2024-01-21T07:40:35.714462+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: audit 2024-01-21T07:40:35.958909+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: audit 2024-01-21T07:40:35.960627+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:36 smithi080 bash[17460]: audit 2024-01-21T07:40:35.963083+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: cluster 2024-01-21T07:40:35.711266+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 628 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: audit 2024-01-21T07:40:35.712995+0000 mon.a (mon.0) 310 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: cluster 2024-01-21T07:40:35.713100+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: audit 2024-01-21T07:40:35.714462+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: audit 2024-01-21T07:40:35.958909+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: audit 2024-01-21T07:40:35.960627+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:37.106 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:36 smithi195 bash[13978]: audit 2024-01-21T07:40:35.963083+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:38.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[13909]: audit 2024-01-21T07:40:35.956399+0000 mgr.y (mgr.14140) 116 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:40:38.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[13909]: cephadm 2024-01-21T07:40:35.958311+0000 mgr.y (mgr.14140) 117 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:40:38.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[13909]: cluster 2024-01-21T07:40:36.726231+0000 mon.a (mon.0) 316 : cluster [INF] osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440] boot 2024-01-21T07:40:38.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[13909]: cluster 2024-01-21T07:40:36.726310+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-01-21T07:40:38.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[13909]: audit 2024-01-21T07:40:36.727879+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:38.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[17460]: audit 2024-01-21T07:40:35.956399+0000 mgr.y (mgr.14140) 116 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:40:38.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[17460]: cephadm 2024-01-21T07:40:35.958311+0000 mgr.y (mgr.14140) 117 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:40:38.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[17460]: cluster 2024-01-21T07:40:36.726231+0000 mon.a (mon.0) 316 : cluster [INF] osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440] boot 2024-01-21T07:40:38.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[17460]: cluster 2024-01-21T07:40:36.726310+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-01-21T07:40:38.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:37 smithi080 bash[17460]: audit 2024-01-21T07:40:36.727879+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:38.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:37 smithi195 bash[13978]: audit 2024-01-21T07:40:35.956399+0000 mgr.y (mgr.14140) 116 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:40:38.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:37 smithi195 bash[13978]: cephadm 2024-01-21T07:40:35.958311+0000 mgr.y (mgr.14140) 117 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:40:38.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:37 smithi195 bash[13978]: cluster 2024-01-21T07:40:36.726231+0000 mon.a (mon.0) 316 : cluster [INF] osd.3 [v2:172.21.15.80:6826/1868846440,v1:172.21.15.80:6827/1868846440] boot 2024-01-21T07:40:38.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:37 smithi195 bash[13978]: cluster 2024-01-21T07:40:36.726310+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-01-21T07:40:38.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:37 smithi195 bash[13978]: audit 2024-01-21T07:40:36.727879+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:40:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:38 smithi080 bash[13909]: cluster 2024-01-21T07:40:37.711823+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 628 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:38 smithi080 bash[13909]: cluster 2024-01-21T07:40:37.749764+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-01-21T07:40:39.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:38 smithi080 bash[17460]: cluster 2024-01-21T07:40:37.711823+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 628 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:39.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:38 smithi080 bash[17460]: cluster 2024-01-21T07:40:37.749764+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-01-21T07:40:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:38 smithi195 bash[13978]: cluster 2024-01-21T07:40:37.711823+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 628 KiB used, 265 GiB / 268 GiB avail 2024-01-21T07:40:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:38 smithi195 bash[13978]: cluster 2024-01-21T07:40:37.749764+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-01-21T07:40:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[13909]: audit 2024-01-21T07:40:39.464626+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.195:0/1353230624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]: dispatch 2024-01-21T07:40:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[13909]: audit 2024-01-21T07:40:39.465619+0000 mon.a (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]: dispatch 2024-01-21T07:40:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[13909]: audit 2024-01-21T07:40:39.475697+0000 mon.a (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]': finished 2024-01-21T07:40:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[13909]: cluster 2024-01-21T07:40:39.475853+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-01-21T07:40:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[13909]: audit 2024-01-21T07:40:39.476192+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[13909]: cluster 2024-01-21T07:40:39.712388+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 876 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:40.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[17460]: audit 2024-01-21T07:40:39.464626+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.195:0/1353230624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]: dispatch 2024-01-21T07:40:40.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[17460]: audit 2024-01-21T07:40:39.465619+0000 mon.a (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]: dispatch 2024-01-21T07:40:40.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[17460]: audit 2024-01-21T07:40:39.475697+0000 mon.a (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]': finished 2024-01-21T07:40:40.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[17460]: cluster 2024-01-21T07:40:39.475853+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-01-21T07:40:40.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[17460]: audit 2024-01-21T07:40:39.476192+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:40.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:39 smithi080 bash[17460]: cluster 2024-01-21T07:40:39.712388+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 876 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:39 smithi195 bash[13978]: audit 2024-01-21T07:40:39.464626+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.195:0/1353230624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]: dispatch 2024-01-21T07:40:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:39 smithi195 bash[13978]: audit 2024-01-21T07:40:39.465619+0000 mon.a (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]: dispatch 2024-01-21T07:40:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:39 smithi195 bash[13978]: audit 2024-01-21T07:40:39.475697+0000 mon.a (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2c86a3c-7c72-4f55-bf73-9ec14d925b25"}]': finished 2024-01-21T07:40:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:39 smithi195 bash[13978]: cluster 2024-01-21T07:40:39.475853+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-01-21T07:40:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:39 smithi195 bash[13978]: audit 2024-01-21T07:40:39.476192+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:39 smithi195 bash[13978]: cluster 2024-01-21T07:40:39.712388+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 876 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:42.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:41 smithi080 bash[17460]: audit 2024-01-21T07:40:41.581588+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.195:0/4048068411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:40:42.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:41 smithi080 bash[13909]: audit 2024-01-21T07:40:41.581588+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.195:0/4048068411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:40:42.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:41 smithi195 bash[13978]: audit 2024-01-21T07:40:41.581588+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.195:0/4048068411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:40:43.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:42 smithi080 bash[13909]: cluster 2024-01-21T07:40:41.712948+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 924 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:43.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:42 smithi080 bash[17460]: cluster 2024-01-21T07:40:41.712948+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 924 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:43.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:42 smithi195 bash[13978]: cluster 2024-01-21T07:40:41.712948+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 924 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:44.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:44 smithi195 bash[13978]: cluster 2024-01-21T07:40:43.713468+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 964 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:44.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:44 smithi195 bash[13978]: audit 2024-01-21T07:40:44.273049+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:44 smithi080 bash[13909]: cluster 2024-01-21T07:40:43.713468+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 964 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:44.973 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:44 smithi080 bash[13909]: audit 2024-01-21T07:40:44.273049+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:44.973 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:44 smithi080 bash[17460]: cluster 2024-01-21T07:40:43.713468+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 964 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:44.973 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:44 smithi080 bash[17460]: audit 2024-01-21T07:40:44.273049+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:45.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:45 smithi195 bash[13978]: cluster 2024-01-21T07:40:45.714079+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 980 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:45 smithi080 bash[13909]: cluster 2024-01-21T07:40:45.714079+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 980 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:46.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:45 smithi080 bash[17460]: cluster 2024-01-21T07:40:45.714079+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 980 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[13909]: cluster 2024-01-21T07:40:47.714780+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[13909]: audit 2024-01-21T07:40:47.739223+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-21T07:40:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[13909]: audit 2024-01-21T07:40:47.741103+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[13909]: audit 2024-01-21T07:40:47.743240+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-01-21T07:40:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[17460]: cluster 2024-01-21T07:40:47.714780+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[17460]: audit 2024-01-21T07:40:47.739223+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-21T07:40:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[17460]: audit 2024-01-21T07:40:47.741103+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:47 smithi080 bash[17460]: audit 2024-01-21T07:40:47.743240+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-01-21T07:40:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:47 smithi195 bash[13978]: cluster 2024-01-21T07:40:47.714780+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:47 smithi195 bash[13978]: audit 2024-01-21T07:40:47.739223+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-21T07:40:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:47 smithi195 bash[13978]: audit 2024-01-21T07:40:47.741103+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:40:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:47 smithi195 bash[13978]: audit 2024-01-21T07:40:47.743240+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-01-21T07:40:49.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:49 smithi195 bash[13978]: cephadm 2024-01-21T07:40:47.742540+0000 mgr.y (mgr.14140) 124 : cephadm [INF] Deploying daemon osd.4 on smithi195 2024-01-21T07:40:49.957 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 4 on host 'smithi195' 2024-01-21T07:40:50.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:49 smithi080 bash[13909]: cephadm 2024-01-21T07:40:47.742540+0000 mgr.y (mgr.14140) 124 : cephadm [INF] Deploying daemon osd.4 on smithi195 2024-01-21T07:40:50.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:49 smithi080 bash[17460]: cephadm 2024-01-21T07:40:47.742540+0000 mgr.y (mgr.14140) 124 : cephadm [INF] Deploying daemon osd.4 on smithi195 2024-01-21T07:40:50.776 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:50 smithi195 bash[13978]: cluster 2024-01-21T07:40:49.715300+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:50.776 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:50 smithi195 bash[13978]: audit 2024-01-21T07:40:49.944538+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:40:50.776 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:50 smithi195 bash[13978]: audit 2024-01-21T07:40:49.945515+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:50.776 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:50 smithi195 bash[13978]: audit 2024-01-21T07:40:49.950664+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:40:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[13909]: cluster 2024-01-21T07:40:49.715300+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[13909]: audit 2024-01-21T07:40:49.944538+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:40:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[13909]: audit 2024-01-21T07:40:49.945515+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[17460]: cluster 2024-01-21T07:40:49.715300+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[17460]: audit 2024-01-21T07:40:49.944538+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:40:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[17460]: audit 2024-01-21T07:40:49.945515+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:40:51.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[17460]: audit 2024-01-21T07:40:49.950664+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:40:51.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:50 smithi080 bash[13909]: audit 2024-01-21T07:40:49.950664+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750246\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:38:52.750448\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_device_update\": \"2024-01-21T07:38:10.965588\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:40:51.219 DEBUG:teuthology.orchestra.run.smithi195:osd.4> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.4.service 2024-01-21T07:40:51.221 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_3... 2024-01-21T07:40:51.221 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-21T07:40:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:51 smithi195 bash[13978]: audit 2024-01-21T07:40:51.104767+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:40:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:51 smithi195 bash[13978]: audit 2024-01-21T07:40:51.110763+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:40:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:51 smithi195 bash[13978]: audit 2024-01-21T07:40:51.112143+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:51.891 INFO:journalctl@ceph.osd.4.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:40:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:51 smithi080 bash[13909]: audit 2024-01-21T07:40:51.104767+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:40:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:51 smithi080 bash[17460]: audit 2024-01-21T07:40:51.104767+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:40:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:51 smithi080 bash[17460]: audit 2024-01-21T07:40:51.110763+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:40:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:51 smithi080 bash[17460]: audit 2024-01-21T07:40:51.112143+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:52.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:51 smithi080 bash[13909]: audit 2024-01-21T07:40:51.110763+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:40:52.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:51 smithi080 bash[13909]: audit 2024-01-21T07:40:51.112143+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-21T07:40:52.556 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[15855]: --> ceph-volume lvm activate successful for osd ID: 4 2024-01-21T07:40:52.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:52 smithi195 bash[13978]: cluster 2024-01-21T07:40:51.715904+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:53.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:52 smithi080 bash[13909]: cluster 2024-01-21T07:40:51.715904+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:53.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:52 smithi080 bash[17460]: cluster 2024-01-21T07:40:51.715904+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:54.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:54 smithi195 bash[13978]: cluster 2024-01-21T07:40:53.716447+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:55.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:54 smithi080 bash[17460]: cluster 2024-01-21T07:40:53.716447+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:55.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:54 smithi080 bash[13909]: cluster 2024-01-21T07:40:53.716447+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:55.341 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:55 smithi195 bash[16062]: debug 2024-01-21T07:40:55.134+0000 7f9bf5753ec0 -1 Falling back to public interface 2024-01-21T07:40:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:55 smithi080 bash[13909]: cluster 2024-01-21T07:40:55.716958+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:55 smithi080 bash[13909]: audit 2024-01-21T07:40:55.775087+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-21T07:40:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:55 smithi080 bash[13909]: audit 2024-01-21T07:40:55.775962+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-21T07:40:56.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:55 smithi080 bash[17460]: cluster 2024-01-21T07:40:55.716958+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:56.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:55 smithi080 bash[17460]: audit 2024-01-21T07:40:55.775087+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-21T07:40:56.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:55 smithi080 bash[17460]: audit 2024-01-21T07:40:55.775962+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-21T07:40:56.137 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:55 smithi195 bash[16062]: debug 2024-01-21T07:40:55.766+0000 7f9bf5753ec0 -1 osd.4 0 log_to_monitors {default=true} 2024-01-21T07:40:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:55 smithi195 bash[13978]: cluster 2024-01-21T07:40:55.716958+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:55 smithi195 bash[13978]: audit 2024-01-21T07:40:55.775087+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-21T07:40:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:55 smithi195 bash[13978]: audit 2024-01-21T07:40:55.775962+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-21T07:40:57.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: cluster 2024-01-21T07:40:56.755040+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:57.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: cluster 2024-01-21T07:40:56.755194+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:57.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: audit 2024-01-21T07:40:56.778137+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-21T07:40:57.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: cluster 2024-01-21T07:40:56.778233+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: audit 2024-01-21T07:40:56.778570+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: audit 2024-01-21T07:40:56.779004+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[13909]: audit 2024-01-21T07:40:56.780076+0000 mon.a (mon.0) 338 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: cluster 2024-01-21T07:40:56.755040+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: cluster 2024-01-21T07:40:56.755194+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: audit 2024-01-21T07:40:56.778137+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: cluster 2024-01-21T07:40:56.778233+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: audit 2024-01-21T07:40:56.778570+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: audit 2024-01-21T07:40:56.779004+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:40:57.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:56 smithi080 bash[17460]: audit 2024-01-21T07:40:56.780076+0000 mon.a (mon.0) 338 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: cluster 2024-01-21T07:40:56.755040+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: cluster 2024-01-21T07:40:56.755194+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: audit 2024-01-21T07:40:56.778137+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: cluster 2024-01-21T07:40:56.778233+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: audit 2024-01-21T07:40:56.778570+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: audit 2024-01-21T07:40:56.779004+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:40:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:56 smithi195 bash[13978]: audit 2024-01-21T07:40:56.780076+0000 mon.a (mon.0) 338 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:40:57.339 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-21T07:40:57.339 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-21T07:40:57.339 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-01-21T07:40:57.339 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-01-21T07:40:57.339 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0148811 s, 705 MB/s 2024-01-21T07:40:57.340 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-01-21T07:40:57.887 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:40:57 smithi195 bash[16062]: debug 2024-01-21T07:40:57.786+0000 7f9bda500700 -1 osd.4 0 waiting for initial osdmap 2024-01-21T07:40:57.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:57 smithi195 bash[13978]: cluster 2024-01-21T07:40:57.717466+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:57.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:57 smithi195 bash[13978]: audit 2024-01-21T07:40:57.781430+0000 mon.a (mon.0) 339 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:40:57.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:57 smithi195 bash[13978]: cluster 2024-01-21T07:40:57.781582+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2024-01-21T07:40:57.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:57 smithi195 bash[13978]: audit 2024-01-21T07:40:57.782007+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:57.998 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-01-21T07:40:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[13909]: cluster 2024-01-21T07:40:57.717466+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[13909]: audit 2024-01-21T07:40:57.781430+0000 mon.a (mon.0) 339 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:40:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[13909]: cluster 2024-01-21T07:40:57.781582+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2024-01-21T07:40:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[13909]: audit 2024-01-21T07:40:57.782007+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:40:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[17460]: cluster 2024-01-21T07:40:57.717466+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 988 KiB used, 354 GiB / 358 GiB avail 2024-01-21T07:40:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[17460]: audit 2024-01-21T07:40:57.781430+0000 mon.a (mon.0) 339 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:40:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[17460]: cluster 2024-01-21T07:40:57.781582+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2024-01-21T07:40:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:57 smithi080 bash[17460]: audit 2024-01-21T07:40:57.782007+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:41:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: cluster 2024-01-21T07:40:58.783983+0000 mon.a (mon.0) 342 : cluster [INF] osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768] boot 2024-01-21T07:41:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: cluster 2024-01-21T07:40:58.784076+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-01-21T07:41:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: audit 2024-01-21T07:40:58.784353+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:41:00.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: audit 2024-01-21T07:40:59.359781+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:00.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: cluster 2024-01-21T07:40:58.783983+0000 mon.a (mon.0) 342 : cluster [INF] osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768] boot 2024-01-21T07:41:00.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: cluster 2024-01-21T07:40:58.784076+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-01-21T07:41:00.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: audit 2024-01-21T07:40:58.784353+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:41:00.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: audit 2024-01-21T07:40:59.359781+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:00.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: audit 2024-01-21T07:40:59.599759+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:00.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: audit 2024-01-21T07:40:59.605893+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:00.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[13909]: cluster 2024-01-21T07:40:59.718109+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:00.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: audit 2024-01-21T07:40:59.599759+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:00.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: audit 2024-01-21T07:40:59.605893+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:00.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:40:59 smithi080 bash[17460]: cluster 2024-01-21T07:40:59.718109+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: cluster 2024-01-21T07:40:58.783983+0000 mon.a (mon.0) 342 : cluster [INF] osd.4 [v2:172.21.15.195:6800/2703158768,v1:172.21.15.195:6801/2703158768] boot 2024-01-21T07:41:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: cluster 2024-01-21T07:40:58.784076+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-01-21T07:41:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: audit 2024-01-21T07:40:58.784353+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:41:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: audit 2024-01-21T07:40:59.359781+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: audit 2024-01-21T07:40:59.599759+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: audit 2024-01-21T07:40:59.605893+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}}, \"last_daemon_update\": \"2024-01-21T07:40:51.103469\", \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:40:59 smithi195 bash[13978]: cluster 2024-01-21T07:40:59.718109+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:01.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:00 smithi080 bash[13909]: cluster 2024-01-21T07:40:59.785274+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-01-21T07:41:01.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:00 smithi080 bash[17460]: cluster 2024-01-21T07:40:59.785274+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-01-21T07:41:01.059 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:00 smithi195 bash[13978]: cluster 2024-01-21T07:40:59.785274+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: cluster 2024-01-21T07:41:00.804666+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: audit 2024-01-21T07:41:01.386288+0000 mgr.y (mgr.14140) 131 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: cephadm 2024-01-21T07:41:01.387797+0000 mgr.y (mgr.14140) 132 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: audit 2024-01-21T07:41:01.388422+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: audit 2024-01-21T07:41:01.390426+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: audit 2024-01-21T07:41:01.393405+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:01.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:01 smithi195 bash[13978]: cluster 2024-01-21T07:41:01.718701+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:02.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: cluster 2024-01-21T07:41:00.804666+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-01-21T07:41:02.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: audit 2024-01-21T07:41:01.386288+0000 mgr.y (mgr.14140) 131 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:02.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: cephadm 2024-01-21T07:41:01.387797+0000 mgr.y (mgr.14140) 132 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: audit 2024-01-21T07:41:01.388422+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: audit 2024-01-21T07:41:01.390426+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: audit 2024-01-21T07:41:01.393405+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[13909]: cluster 2024-01-21T07:41:01.718701+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: cluster 2024-01-21T07:41:00.804666+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: audit 2024-01-21T07:41:01.386288+0000 mgr.y (mgr.14140) 131 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: cephadm 2024-01-21T07:41:01.387797+0000 mgr.y (mgr.14140) 132 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: audit 2024-01-21T07:41:01.388422+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: audit 2024-01-21T07:41:01.390426+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:02.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: audit 2024-01-21T07:41:01.393405+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:02.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:01 smithi080 bash[17460]: cluster 2024-01-21T07:41:01.718701+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:04 smithi080 bash[13909]: cluster 2024-01-21T07:41:03.719342+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:05.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:04 smithi080 bash[17460]: cluster 2024-01-21T07:41:03.719342+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:05.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:04 smithi195 bash[13978]: cluster 2024-01-21T07:41:03.719342+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[13909]: audit 2024-01-21T07:41:04.761228+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.195:0/2078751364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]: dispatch 2024-01-21T07:41:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[13909]: audit 2024-01-21T07:41:04.762314+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]: dispatch 2024-01-21T07:41:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[13909]: audit 2024-01-21T07:41:04.772340+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]': finished 2024-01-21T07:41:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[13909]: cluster 2024-01-21T07:41:04.772448+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-01-21T07:41:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[13909]: audit 2024-01-21T07:41:04.772743+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[17460]: audit 2024-01-21T07:41:04.761228+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.195:0/2078751364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]: dispatch 2024-01-21T07:41:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[17460]: audit 2024-01-21T07:41:04.762314+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]: dispatch 2024-01-21T07:41:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[17460]: audit 2024-01-21T07:41:04.772340+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]': finished 2024-01-21T07:41:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[17460]: cluster 2024-01-21T07:41:04.772448+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-01-21T07:41:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:05 smithi080 bash[17460]: audit 2024-01-21T07:41:04.772743+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:05 smithi195 bash[13978]: audit 2024-01-21T07:41:04.761228+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.195:0/2078751364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]: dispatch 2024-01-21T07:41:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:05 smithi195 bash[13978]: audit 2024-01-21T07:41:04.762314+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]: dispatch 2024-01-21T07:41:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:05 smithi195 bash[13978]: audit 2024-01-21T07:41:04.772340+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20fb8ae4-0923-4d21-936c-8c8ebbc279f8"}]': finished 2024-01-21T07:41:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:05 smithi195 bash[13978]: cluster 2024-01-21T07:41:04.772448+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-01-21T07:41:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:05 smithi195 bash[13978]: audit 2024-01-21T07:41:04.772743+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:07.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:06 smithi080 bash[13909]: cluster 2024-01-21T07:41:05.720216+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:07.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:06 smithi080 bash[17460]: cluster 2024-01-21T07:41:05.720216+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:07.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:06 smithi195 bash[13978]: cluster 2024-01-21T07:41:05.720216+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:08.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:07 smithi080 bash[13909]: audit 2024-01-21T07:41:06.915582+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.195:0/3016399896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:41:08.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:07 smithi080 bash[17460]: audit 2024-01-21T07:41:06.915582+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.195:0/3016399896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:41:08.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:07 smithi195 bash[13978]: audit 2024-01-21T07:41:06.915582+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.195:0/3016399896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:41:09.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:08 smithi080 bash[17460]: cluster 2024-01-21T07:41:07.720873+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:09.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:08 smithi080 bash[13909]: cluster 2024-01-21T07:41:07.720873+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:09.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:08 smithi195 bash[13978]: cluster 2024-01-21T07:41:07.720873+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:10.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:09 smithi080 bash[13909]: audit 2024-01-21T07:41:09.583385+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:09 smithi080 bash[17460]: audit 2024-01-21T07:41:09.583385+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:10.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:09 smithi195 bash[13978]: audit 2024-01-21T07:41:09.583385+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:10.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:10 smithi195 bash[13978]: cluster 2024-01-21T07:41:09.721392+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:11.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:10 smithi080 bash[17460]: cluster 2024-01-21T07:41:09.721392+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:11.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:10 smithi080 bash[13909]: cluster 2024-01-21T07:41:09.721392+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:12.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:11 smithi195 bash[13978]: cluster 2024-01-21T07:41:11.721955+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:12.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:11 smithi080 bash[13909]: cluster 2024-01-21T07:41:11.721955+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:12.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:11 smithi080 bash[17460]: cluster 2024-01-21T07:41:11.721955+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:13.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:13 smithi080 bash[13909]: audit 2024-01-21T07:41:13.148533+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-21T07:41:13.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:13 smithi080 bash[13909]: audit 2024-01-21T07:41:13.150325+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:13.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:13 smithi080 bash[13909]: audit 2024-01-21T07:41:13.152434+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-01-21T07:41:13.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:13 smithi080 bash[17460]: audit 2024-01-21T07:41:13.148533+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-21T07:41:13.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:13 smithi080 bash[17460]: audit 2024-01-21T07:41:13.150325+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:13.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:13 smithi080 bash[17460]: audit 2024-01-21T07:41:13.152434+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-01-21T07:41:13.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:13 smithi195 bash[13978]: audit 2024-01-21T07:41:13.148533+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-21T07:41:13.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:13 smithi195 bash[13978]: audit 2024-01-21T07:41:13.150325+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:13.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:13 smithi195 bash[13978]: audit 2024-01-21T07:41:13.152434+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-01-21T07:41:14.879 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:14 smithi195 bash[13978]: cephadm 2024-01-21T07:41:13.151838+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.5 on smithi195 2024-01-21T07:41:14.879 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:14 smithi195 bash[13978]: cluster 2024-01-21T07:41:13.722482+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:14 smithi080 bash[13909]: cephadm 2024-01-21T07:41:13.151838+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.5 on smithi195 2024-01-21T07:41:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:14 smithi080 bash[13909]: cluster 2024-01-21T07:41:13.722482+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:15.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:14 smithi080 bash[17460]: cephadm 2024-01-21T07:41:13.151838+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.5 on smithi195 2024-01-21T07:41:15.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:14 smithi080 bash[17460]: cluster 2024-01-21T07:41:13.722482+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:15.346 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-01-21T07:41:16.025 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:15 smithi195 bash[13978]: audit 2024-01-21T07:41:15.333075+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:16.025 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:15 smithi195 bash[13978]: audit 2024-01-21T07:41:15.334053+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:16.025 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:15 smithi195 bash[13978]: audit 2024-01-21T07:41:15.339552+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:15 smithi080 bash[13909]: audit 2024-01-21T07:41:15.333075+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:15 smithi080 bash[13909]: audit 2024-01-21T07:41:15.334053+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:15 smithi080 bash[13909]: audit 2024-01-21T07:41:15.339552+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:15 smithi080 bash[17460]: audit 2024-01-21T07:41:15.333075+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:15 smithi080 bash[17460]: audit 2024-01-21T07:41:15.334053+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:15 smithi080 bash[17460]: audit 2024-01-21T07:41:15.339552+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.102954\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103151\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:51.103277\", \"created\": \"2024-01-21T07:40:49.926393\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_device_update\": \"2024-01-21T07:40:59.598393\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:16.752 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.5.service 2024-01-21T07:41:16.754 INFO:tasks.cephadm:Deploying osd.6 on smithi195 with /dev/vg_nvme/lv_2... 2024-01-21T07:41:16.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-21T07:41:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[13909]: cluster 2024-01-21T07:41:15.723107+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[17460]: cluster 2024-01-21T07:41:15.723107+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[13909]: audit 2024-01-21T07:41:16.634395+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[13909]: audit 2024-01-21T07:41:16.640590+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[13909]: audit 2024-01-21T07:41:16.642104+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[17460]: audit 2024-01-21T07:41:16.634395+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:17.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[17460]: audit 2024-01-21T07:41:16.640590+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:17.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:16 smithi080 bash[17460]: audit 2024-01-21T07:41:16.642104+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:17.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:16 smithi195 bash[13978]: cluster 2024-01-21T07:41:15.723107+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:16 smithi195 bash[13978]: audit 2024-01-21T07:41:16.634395+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:16 smithi195 bash[13978]: audit 2024-01-21T07:41:16.640590+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:16 smithi195 bash[13978]: audit 2024-01-21T07:41:16.642104+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:18.120 INFO:journalctl@ceph.osd.5.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:41:18.120 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-21T07:41:18.120 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-01-21T07:41:18.120 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-01-21T07:41:18.120 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-01-21T07:41:18.120 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-01-21T07:41:18.121 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-21T07:41:18.121 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:17 smithi195 bash[17441]: --> ceph-volume lvm activate successful for osd ID: 5 2024-01-21T07:41:19.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:18 smithi080 bash[13909]: cluster 2024-01-21T07:41:17.723661+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:19.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:18 smithi080 bash[17460]: cluster 2024-01-21T07:41:17.723661+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:19.107 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:18 smithi195 bash[13978]: cluster 2024-01-21T07:41:17.723661+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:20.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:19 smithi080 bash[13909]: cluster 2024-01-21T07:41:19.724200+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:19 smithi080 bash[13909]: audit 2024-01-21T07:41:19.741308+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:41:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:19 smithi080 bash[13909]: audit 2024-01-21T07:41:19.751912+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:41:20.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:19 smithi080 bash[17460]: cluster 2024-01-21T07:41:19.724200+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:20.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:19 smithi080 bash[17460]: audit 2024-01-21T07:41:19.741308+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:41:20.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:19 smithi080 bash[17460]: audit 2024-01-21T07:41:19.751912+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:41:20.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:19 smithi195 bash[13978]: cluster 2024-01-21T07:41:19.724200+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:20.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:19 smithi195 bash[13978]: audit 2024-01-21T07:41:19.741308+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:41:20.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:19 smithi195 bash[13978]: audit 2024-01-21T07:41:19.751912+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:41:22.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:21 smithi080 bash[13909]: cluster 2024-01-21T07:41:21.724734+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:22.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:21 smithi080 bash[17460]: cluster 2024-01-21T07:41:21.724734+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:22.137 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:21 smithi195 bash[17662]: debug 2024-01-21T07:41:21.833+0000 7feddc3f4ec0 -1 Falling back to public interface 2024-01-21T07:41:22.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:21 smithi195 bash[13978]: cluster 2024-01-21T07:41:21.724734+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:22.805 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:22 smithi195 bash[17662]: debug 2024-01-21T07:41:22.457+0000 7feddc3f4ec0 -1 osd.5 0 log_to_monitors {default=true} 2024-01-21T07:41:23.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:22 smithi080 bash[13909]: audit 2024-01-21T07:41:22.465670+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-21T07:41:23.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:22 smithi080 bash[13909]: audit 2024-01-21T07:41:22.466645+0000 mon.a (mon.0) 369 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-21T07:41:23.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:22 smithi080 bash[17460]: audit 2024-01-21T07:41:22.465670+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-21T07:41:23.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:22 smithi080 bash[17460]: audit 2024-01-21T07:41:22.466645+0000 mon.a (mon.0) 369 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-21T07:41:23.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:22 smithi195 bash[13978]: audit 2024-01-21T07:41:22.465670+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-21T07:41:23.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:22 smithi195 bash[13978]: audit 2024-01-21T07:41:22.466645+0000 mon.a (mon.0) 369 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-21T07:41:23.152 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-21T07:41:23.152 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-21T07:41:23.152 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-01-21T07:41:23.152 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-01-21T07:41:23.152 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0166521 s, 630 MB/s 2024-01-21T07:41:23.152 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: audit 2024-01-21T07:41:22.815673+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: cluster 2024-01-21T07:41:22.815755+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: audit 2024-01-21T07:41:22.815931+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: audit 2024-01-21T07:41:22.816255+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: audit 2024-01-21T07:41:22.816984+0000 mon.a (mon.0) 373 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: cluster 2024-01-21T07:41:23.441195+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: cluster 2024-01-21T07:41:23.441271+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:41:23.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[13978]: cluster 2024-01-21T07:41:23.725267+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:23.848 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-01-21T07:41:24.137 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:41:23 smithi195 bash[17662]: debug 2024-01-21T07:41:23.829+0000 7fedc51a9700 -1 osd.5 0 waiting for initial osdmap 2024-01-21T07:41:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: audit 2024-01-21T07:41:22.815673+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: cluster 2024-01-21T07:41:22.815755+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: audit 2024-01-21T07:41:22.815931+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: audit 2024-01-21T07:41:22.816255+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: audit 2024-01-21T07:41:22.816984+0000 mon.a (mon.0) 373 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: cluster 2024-01-21T07:41:23.441195+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: cluster 2024-01-21T07:41:23.441271+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[13909]: cluster 2024-01-21T07:41:23.725267+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: audit 2024-01-21T07:41:22.815673+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: cluster 2024-01-21T07:41:22.815755+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: audit 2024-01-21T07:41:22.815931+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:24.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: audit 2024-01-21T07:41:22.816255+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:24.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: audit 2024-01-21T07:41:22.816984+0000 mon.a (mon.0) 373 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:24.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: cluster 2024-01-21T07:41:23.441195+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:41:24.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: cluster 2024-01-21T07:41:23.441271+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:41:24.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:23 smithi080 bash[17460]: cluster 2024-01-21T07:41:23.725267+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail 2024-01-21T07:41:25.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:24 smithi195 bash[13978]: audit 2024-01-21T07:41:23.824157+0000 mon.a (mon.0) 374 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:41:25.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:24 smithi195 bash[13978]: cluster 2024-01-21T07:41:23.824281+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2024-01-21T07:41:25.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:24 smithi195 bash[13978]: audit 2024-01-21T07:41:23.825252+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:24 smithi080 bash[13909]: audit 2024-01-21T07:41:23.824157+0000 mon.a (mon.0) 374 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:41:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:24 smithi080 bash[13909]: cluster 2024-01-21T07:41:23.824281+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2024-01-21T07:41:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:24 smithi080 bash[13909]: audit 2024-01-21T07:41:23.825252+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:24 smithi080 bash[17460]: audit 2024-01-21T07:41:23.824157+0000 mon.a (mon.0) 374 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:41:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:24 smithi080 bash[17460]: cluster 2024-01-21T07:41:23.824281+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2024-01-21T07:41:25.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:24 smithi080 bash[17460]: audit 2024-01-21T07:41:23.825252+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:26.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: cluster 2024-01-21T07:41:24.828731+0000 mon.a (mon.0) 377 : cluster [INF] osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419] boot 2024-01-21T07:41:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: cluster 2024-01-21T07:41:24.828829+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-01-21T07:41:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: audit 2024-01-21T07:41:24.829181+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: audit 2024-01-21T07:41:25.052375+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: audit 2024-01-21T07:41:25.291906+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: audit 2024-01-21T07:41:25.297263+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:26.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:25 smithi195 bash[13978]: cluster 2024-01-21T07:41:25.725859+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:26.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: cluster 2024-01-21T07:41:24.828731+0000 mon.a (mon.0) 377 : cluster [INF] osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419] boot 2024-01-21T07:41:26.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: cluster 2024-01-21T07:41:24.828829+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-01-21T07:41:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: audit 2024-01-21T07:41:24.829181+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: audit 2024-01-21T07:41:25.052375+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: audit 2024-01-21T07:41:25.291906+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: audit 2024-01-21T07:41:25.297263+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[17460]: cluster 2024-01-21T07:41:25.725859+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:26.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: cluster 2024-01-21T07:41:24.828731+0000 mon.a (mon.0) 377 : cluster [INF] osd.5 [v2:172.21.15.195:6808/1748131419,v1:172.21.15.195:6809/1748131419] boot 2024-01-21T07:41:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: cluster 2024-01-21T07:41:24.828829+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-01-21T07:41:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: audit 2024-01-21T07:41:24.829181+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:41:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: audit 2024-01-21T07:41:25.052375+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: audit 2024-01-21T07:41:25.291906+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: audit 2024-01-21T07:41:25.297263+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}}, \"last_daemon_update\": \"2024-01-21T07:41:16.632911\", \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:25 smithi080 bash[13909]: cluster 2024-01-21T07:41:25.725859+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:26.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:26 smithi195 bash[13978]: cluster 2024-01-21T07:41:25.841266+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-01-21T07:41:26.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:26 smithi195 bash[13978]: cluster 2024-01-21T07:41:26.294201+0000 mon.a (mon.0) 384 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:41:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:26 smithi080 bash[13909]: cluster 2024-01-21T07:41:25.841266+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-01-21T07:41:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:26 smithi080 bash[13909]: cluster 2024-01-21T07:41:26.294201+0000 mon.a (mon.0) 384 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:41:27.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:26 smithi080 bash[17460]: cluster 2024-01-21T07:41:25.841266+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-01-21T07:41:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:26 smithi080 bash[17460]: cluster 2024-01-21T07:41:26.294201+0000 mon.a (mon.0) 384 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:41:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:27 smithi195 bash[13978]: audit 2024-01-21T07:41:27.014393+0000 mgr.y (mgr.14140) 147 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:27 smithi195 bash[13978]: cephadm 2024-01-21T07:41:27.015871+0000 mgr.y (mgr.14140) 148 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:27 smithi195 bash[13978]: audit 2024-01-21T07:41:27.016437+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:27 smithi195 bash[13978]: audit 2024-01-21T07:41:27.018225+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:27 smithi195 bash[13978]: audit 2024-01-21T07:41:27.021068+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:28.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:27 smithi195 bash[13978]: cluster 2024-01-21T07:41:27.726377+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[13909]: audit 2024-01-21T07:41:27.014393+0000 mgr.y (mgr.14140) 147 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[13909]: cephadm 2024-01-21T07:41:27.015871+0000 mgr.y (mgr.14140) 148 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[13909]: audit 2024-01-21T07:41:27.016437+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[13909]: audit 2024-01-21T07:41:27.018225+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[13909]: audit 2024-01-21T07:41:27.021068+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[13909]: cluster 2024-01-21T07:41:27.726377+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[17460]: audit 2024-01-21T07:41:27.014393+0000 mgr.y (mgr.14140) 147 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[17460]: cephadm 2024-01-21T07:41:27.015871+0000 mgr.y (mgr.14140) 148 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[17460]: audit 2024-01-21T07:41:27.016437+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[17460]: audit 2024-01-21T07:41:27.018225+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[17460]: audit 2024-01-21T07:41:27.021068+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:27 smithi080 bash[17460]: cluster 2024-01-21T07:41:27.726377+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:30.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:29 smithi080 bash[13909]: cluster 2024-01-21T07:41:29.726943+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:30.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:29 smithi080 bash[17460]: cluster 2024-01-21T07:41:29.726943+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:30.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:29 smithi195 bash[13978]: cluster 2024-01-21T07:41:29.726943+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:31.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[13909]: audit 2024-01-21T07:41:30.281268+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.195:0/3580335304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]: dispatch 2024-01-21T07:41:31.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[13909]: audit 2024-01-21T07:41:30.282341+0000 mon.a (mon.0) 388 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]: dispatch 2024-01-21T07:41:31.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[13909]: audit 2024-01-21T07:41:30.293132+0000 mon.a (mon.0) 389 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]': finished 2024-01-21T07:41:31.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[13909]: cluster 2024-01-21T07:41:30.293229+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-01-21T07:41:31.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[13909]: audit 2024-01-21T07:41:30.293556+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:31.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[17460]: audit 2024-01-21T07:41:30.281268+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.195:0/3580335304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]: dispatch 2024-01-21T07:41:31.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[17460]: audit 2024-01-21T07:41:30.282341+0000 mon.a (mon.0) 388 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]: dispatch 2024-01-21T07:41:31.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[17460]: audit 2024-01-21T07:41:30.293132+0000 mon.a (mon.0) 389 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]': finished 2024-01-21T07:41:31.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[17460]: cluster 2024-01-21T07:41:30.293229+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-01-21T07:41:31.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:30 smithi080 bash[17460]: audit 2024-01-21T07:41:30.293556+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:31.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:30 smithi195 bash[13978]: audit 2024-01-21T07:41:30.281268+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.195:0/3580335304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]: dispatch 2024-01-21T07:41:31.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:30 smithi195 bash[13978]: audit 2024-01-21T07:41:30.282341+0000 mon.a (mon.0) 388 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]: dispatch 2024-01-21T07:41:31.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:30 smithi195 bash[13978]: audit 2024-01-21T07:41:30.293132+0000 mon.a (mon.0) 389 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e78aad1-ff7d-47d1-aabf-a437f0a10df6"}]': finished 2024-01-21T07:41:31.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:30 smithi195 bash[13978]: cluster 2024-01-21T07:41:30.293229+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-01-21T07:41:31.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:30 smithi195 bash[13978]: audit 2024-01-21T07:41:30.293556+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:32.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:31 smithi195 bash[13978]: cluster 2024-01-21T07:41:31.727502+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:32.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:31 smithi080 bash[13909]: cluster 2024-01-21T07:41:31.727502+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:32.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:31 smithi080 bash[17460]: cluster 2024-01-21T07:41:31.727502+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:33.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:32 smithi195 bash[13978]: cluster 2024-01-21T07:41:31.804467+0000 mon.a (mon.0) 392 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-21T07:41:33.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:32 smithi195 bash[13978]: cluster 2024-01-21T07:41:31.804535+0000 mon.a (mon.0) 393 : cluster [INF] Cluster is now healthy 2024-01-21T07:41:33.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:32 smithi195 bash[13978]: audit 2024-01-21T07:41:32.384921+0000 mon.b (mon.2) 13 : audit [DBG] from='client.? 172.21.15.195:0/2353965036' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:41:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:32 smithi080 bash[13909]: cluster 2024-01-21T07:41:31.804467+0000 mon.a (mon.0) 392 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-21T07:41:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:32 smithi080 bash[13909]: cluster 2024-01-21T07:41:31.804535+0000 mon.a (mon.0) 393 : cluster [INF] Cluster is now healthy 2024-01-21T07:41:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:32 smithi080 bash[13909]: audit 2024-01-21T07:41:32.384921+0000 mon.b (mon.2) 13 : audit [DBG] from='client.? 172.21.15.195:0/2353965036' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:41:33.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:32 smithi080 bash[17460]: cluster 2024-01-21T07:41:31.804467+0000 mon.a (mon.0) 392 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-21T07:41:33.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:32 smithi080 bash[17460]: cluster 2024-01-21T07:41:31.804535+0000 mon.a (mon.0) 393 : cluster [INF] Cluster is now healthy 2024-01-21T07:41:33.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:32 smithi080 bash[17460]: audit 2024-01-21T07:41:32.384921+0000 mon.b (mon.2) 13 : audit [DBG] from='client.? 172.21.15.195:0/2353965036' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:41:35.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:34 smithi080 bash[13909]: cluster 2024-01-21T07:41:33.728059+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:35.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:34 smithi080 bash[17460]: cluster 2024-01-21T07:41:33.728059+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:35.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:34 smithi195 bash[13978]: cluster 2024-01-21T07:41:33.728059+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:35 smithi080 bash[13909]: audit 2024-01-21T07:41:35.088233+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:36.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:35 smithi080 bash[17460]: audit 2024-01-21T07:41:35.088233+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:36.064 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:35 smithi195 bash[13978]: audit 2024-01-21T07:41:35.088233+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:37.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:36 smithi080 bash[17460]: cluster 2024-01-21T07:41:35.728627+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:36 smithi080 bash[13909]: cluster 2024-01-21T07:41:35.728627+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:37.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:36 smithi195 bash[13978]: cluster 2024-01-21T07:41:35.728627+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[13909]: cluster 2024-01-21T07:41:37.729214+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[13909]: audit 2024-01-21T07:41:38.678922+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-21T07:41:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[13909]: audit 2024-01-21T07:41:38.680729+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[13909]: audit 2024-01-21T07:41:38.682793+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-01-21T07:41:39.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[17460]: cluster 2024-01-21T07:41:37.729214+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:39.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[17460]: audit 2024-01-21T07:41:38.678922+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-21T07:41:39.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[17460]: audit 2024-01-21T07:41:38.680729+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:39.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:38 smithi080 bash[17460]: audit 2024-01-21T07:41:38.682793+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-01-21T07:41:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:38 smithi195 bash[13978]: cluster 2024-01-21T07:41:37.729214+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:38 smithi195 bash[13978]: audit 2024-01-21T07:41:38.678922+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-21T07:41:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:38 smithi195 bash[13978]: audit 2024-01-21T07:41:38.680729+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:39.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:38 smithi195 bash[13978]: audit 2024-01-21T07:41:38.682793+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-01-21T07:41:40.048 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:39 smithi195 bash[13978]: cephadm 2024-01-21T07:41:38.682150+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Deploying daemon osd.6 on smithi195 2024-01-21T07:41:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:39 smithi080 bash[13909]: cephadm 2024-01-21T07:41:38.682150+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Deploying daemon osd.6 on smithi195 2024-01-21T07:41:40.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:39 smithi080 bash[17460]: cephadm 2024-01-21T07:41:38.682150+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Deploying daemon osd.6 on smithi195 2024-01-21T07:41:40.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:40 smithi195 bash[13978]: cluster 2024-01-21T07:41:39.729758+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:41.030 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 6 on host 'smithi195' 2024-01-21T07:41:41.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:40 smithi080 bash[13909]: cluster 2024-01-21T07:41:39.729758+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:41.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:40 smithi080 bash[17460]: cluster 2024-01-21T07:41:39.729758+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-21T07:41:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[13909]: audit 2024-01-21T07:41:41.017146+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[13909]: audit 2024-01-21T07:41:41.018138+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:42.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[17460]: audit 2024-01-21T07:41:41.017146+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:42.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[17460]: audit 2024-01-21T07:41:41.018138+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[13909]: audit 2024-01-21T07:41:41.026536+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:42.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[13909]: cluster 2024-01-21T07:41:41.730309+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[17460]: audit 2024-01-21T07:41:41.026536+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:41 smithi080 bash[17460]: cluster 2024-01-21T07:41:41.730309+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:42.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:41 smithi195 bash[13978]: audit 2024-01-21T07:41:41.017146+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:42.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:41 smithi195 bash[13978]: audit 2024-01-21T07:41:41.018138+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:42.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:41 smithi195 bash[13978]: audit 2024-01-21T07:41:41.026536+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632277\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632474\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632600\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:16.632719\", \"created\": \"2024-01-21T07:41:15.313825\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_device_update\": \"2024-01-21T07:41:25.290589\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:42.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:41 smithi195 bash[13978]: cluster 2024-01-21T07:41:41.730309+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:42.817 DEBUG:teuthology.orchestra.run.smithi195:osd.6> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.6.service 2024-01-21T07:41:42.819 INFO:tasks.cephadm:Deploying osd.7 on smithi195 with /dev/vg_nvme/lv_1... 2024-01-21T07:41:42.820 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-21T07:41:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:42 smithi080 bash[13909]: audit 2024-01-21T07:41:41.917585+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:43.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:42 smithi080 bash[17460]: audit 2024-01-21T07:41:41.917585+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:42 smithi080 bash[13909]: audit 2024-01-21T07:41:41.923598+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:42 smithi080 bash[13909]: audit 2024-01-21T07:41:41.924972+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:43.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:42 smithi080 bash[17460]: audit 2024-01-21T07:41:41.923598+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:43.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:42 smithi080 bash[17460]: audit 2024-01-21T07:41:41.924972+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:43.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:42 smithi195 bash[13978]: audit 2024-01-21T07:41:41.917585+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:43.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:42 smithi195 bash[13978]: audit 2024-01-21T07:41:41.923598+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:43.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:42 smithi195 bash[13978]: audit 2024-01-21T07:41:41.924972+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-21T07:41:44.362 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:43 smithi195 bash[19026]: --> ceph-volume lvm activate successful for osd ID: 6 2024-01-21T07:41:45.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:44 smithi080 bash[13909]: cluster 2024-01-21T07:41:43.730996+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:45.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:44 smithi080 bash[17460]: cluster 2024-01-21T07:41:43.730996+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:45.062 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:44 smithi195 bash[13978]: cluster 2024-01-21T07:41:43.730996+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:46.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:45 smithi080 bash[17460]: audit 2024-01-21T07:41:44.754231+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:41:46.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:45 smithi080 bash[17460]: audit 2024-01-21T07:41:44.759700+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:41:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:45 smithi080 bash[13909]: audit 2024-01-21T07:41:44.754231+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:41:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:45 smithi080 bash[13909]: audit 2024-01-21T07:41:44.759700+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:41:46.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:45 smithi195 bash[13978]: audit 2024-01-21T07:41:44.754231+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:41:46.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:45 smithi195 bash[13978]: audit 2024-01-21T07:41:44.759700+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:41:47.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:46 smithi080 bash[17460]: cluster 2024-01-21T07:41:45.731669+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:46 smithi080 bash[13909]: cluster 2024-01-21T07:41:45.731669+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:47.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:46 smithi195 bash[13978]: cluster 2024-01-21T07:41:45.731669+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:48.637 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:48 smithi195 bash[19324]: debug 2024-01-21T07:41:48.401+0000 7f0b5386bec0 -1 Falling back to public interface 2024-01-21T07:41:49.034 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:48 smithi195 bash[13978]: cluster 2024-01-21T07:41:47.732199+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:49.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:48 smithi080 bash[13909]: cluster 2024-01-21T07:41:47.732199+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:49.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:48 smithi080 bash[17460]: cluster 2024-01-21T07:41:47.732199+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:49.387 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:49 smithi195 bash[19324]: debug 2024-01-21T07:41:49.029+0000 7f0b5386bec0 -1 osd.6 0 log_to_monitors {default=true} 2024-01-21T07:41:49.418 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-21T07:41:49.418 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-21T07:41:49.418 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-01-21T07:41:49.418 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-01-21T07:41:49.418 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0150742 s, 696 MB/s 2024-01-21T07:41:49.418 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-01-21T07:41:50.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:49 smithi080 bash[13909]: audit 2024-01-21T07:41:49.036781+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-21T07:41:50.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:49 smithi080 bash[13909]: audit 2024-01-21T07:41:49.037893+0000 mon.a (mon.0) 406 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-21T07:41:50.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:49 smithi080 bash[17460]: audit 2024-01-21T07:41:49.036781+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-21T07:41:50.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:49 smithi080 bash[17460]: audit 2024-01-21T07:41:49.037893+0000 mon.a (mon.0) 406 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-21T07:41:50.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:49 smithi195 bash[13978]: audit 2024-01-21T07:41:49.036781+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-21T07:41:50.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:49 smithi195 bash[13978]: audit 2024-01-21T07:41:49.037893+0000 mon.a (mon.0) 406 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-21T07:41:50.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2024-01-21T07:41:50.774 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: cluster 2024-01-21T07:41:49.732839+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:50.774 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:49.760557+0000 mon.a (mon.0) 407 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-21T07:41:50.774 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: cluster 2024-01-21T07:41:49.760667+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2024-01-21T07:41:50.774 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:49.760948+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:49.761272+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:49.762248+0000 mon.a (mon.0) 410 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: cluster 2024-01-21T07:41:50.009127+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: cluster 2024-01-21T07:41:50.009196+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:50.382404+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:50.612037+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:50.775 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[13978]: audit 2024-01-21T07:41:50.617823+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:51.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: cluster 2024-01-21T07:41:49.732839+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:49.760557+0000 mon.a (mon.0) 407 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: cluster 2024-01-21T07:41:49.760667+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:49.760948+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:49.761272+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:49.762248+0000 mon.a (mon.0) 410 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: cluster 2024-01-21T07:41:50.009127+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: cluster 2024-01-21T07:41:50.009196+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:50.382404+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:51.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: cluster 2024-01-21T07:41:49.732839+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:49.760557+0000 mon.a (mon.0) 407 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: cluster 2024-01-21T07:41:49.760667+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:49.760948+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:49.761272+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:49.762248+0000 mon.a (mon.0) 410 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: cluster 2024-01-21T07:41:50.009127+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: cluster 2024-01-21T07:41:50.009196+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:50.382404+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:41:51.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:50.612037+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:51.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:50.612037+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:41:51.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[17460]: audit 2024-01-21T07:41:50.617823+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:51.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:50 smithi080 bash[13909]: audit 2024-01-21T07:41:50.617823+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}}, \"last_daemon_update\": \"2024-01-21T07:41:41.916011\", \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:41:51.137 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:41:50 smithi195 bash[19324]: debug 2024-01-21T07:41:50.769+0000 7f0b38618700 -1 osd.6 0 waiting for initial osdmap 2024-01-21T07:41:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:51 smithi195 bash[13978]: audit 2024-01-21T07:41:50.767000+0000 mon.a (mon.0) 414 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:41:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:51 smithi195 bash[13978]: cluster 2024-01-21T07:41:50.767134+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2024-01-21T07:41:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:51 smithi195 bash[13978]: audit 2024-01-21T07:41:50.767294+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:51.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:51 smithi195 bash[13978]: cluster 2024-01-21T07:41:51.733405+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[13909]: audit 2024-01-21T07:41:50.767000+0000 mon.a (mon.0) 414 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:41:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[13909]: cluster 2024-01-21T07:41:50.767134+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2024-01-21T07:41:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[13909]: audit 2024-01-21T07:41:50.767294+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[13909]: cluster 2024-01-21T07:41:51.733405+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:52.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[17460]: audit 2024-01-21T07:41:50.767000+0000 mon.a (mon.0) 414 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:41:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[17460]: cluster 2024-01-21T07:41:50.767134+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2024-01-21T07:41:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[17460]: audit 2024-01-21T07:41:50.767294+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:51 smithi080 bash[17460]: cluster 2024-01-21T07:41:51.733405+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-01-21T07:41:53.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:52 smithi080 bash[13909]: cluster 2024-01-21T07:41:51.771795+0000 mon.a (mon.0) 417 : cluster [INF] osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859] boot 2024-01-21T07:41:53.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:52 smithi080 bash[13909]: cluster 2024-01-21T07:41:51.771931+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-01-21T07:41:53.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:52 smithi080 bash[13909]: audit 2024-01-21T07:41:51.773394+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:53.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:52 smithi080 bash[17460]: cluster 2024-01-21T07:41:51.771795+0000 mon.a (mon.0) 417 : cluster [INF] osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859] boot 2024-01-21T07:41:53.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:52 smithi080 bash[17460]: cluster 2024-01-21T07:41:51.771931+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-01-21T07:41:53.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:52 smithi080 bash[17460]: audit 2024-01-21T07:41:51.773394+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:52 smithi195 bash[13978]: cluster 2024-01-21T07:41:51.771795+0000 mon.a (mon.0) 417 : cluster [INF] osd.6 [v2:172.21.15.195:6816/129712859,v1:172.21.15.195:6817/129712859] boot 2024-01-21T07:41:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:52 smithi195 bash[13978]: cluster 2024-01-21T07:41:51.771931+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-01-21T07:41:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:52 smithi195 bash[13978]: audit 2024-01-21T07:41:51.773394+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:41:54.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: cluster 2024-01-21T07:41:52.792239+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-01-21T07:41:54.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: audit 2024-01-21T07:41:53.188925+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:54.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: cephadm 2024-01-21T07:41:53.190419+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:54.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: audit 2024-01-21T07:41:53.191017+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:54.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: audit 2024-01-21T07:41:53.192975+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: audit 2024-01-21T07:41:53.196001+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[13909]: cluster 2024-01-21T07:41:53.733931+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: cluster 2024-01-21T07:41:52.792239+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: audit 2024-01-21T07:41:53.188925+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: cephadm 2024-01-21T07:41:53.190419+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: audit 2024-01-21T07:41:53.191017+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: audit 2024-01-21T07:41:53.192975+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: audit 2024-01-21T07:41:53.196001+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:54.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:53 smithi080 bash[17460]: cluster 2024-01-21T07:41:53.733931+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:54.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: cluster 2024-01-21T07:41:52.792239+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-01-21T07:41:54.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: audit 2024-01-21T07:41:53.188925+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:41:54.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: cephadm 2024-01-21T07:41:53.190419+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Applying osd on host smithi195... 2024-01-21T07:41:54.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: audit 2024-01-21T07:41:53.191017+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-21T07:41:54.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: audit 2024-01-21T07:41:53.192975+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:41:54.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: audit 2024-01-21T07:41:53.196001+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:41:54.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:53 smithi195 bash[13978]: cluster 2024-01-21T07:41:53.733931+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:55 smithi080 bash[13909]: cluster 2024-01-21T07:41:55.734475+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:56.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:55 smithi080 bash[17460]: cluster 2024-01-21T07:41:55.734475+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:55 smithi195 bash[13978]: cluster 2024-01-21T07:41:55.734475+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:56 smithi195 bash[13978]: audit 2024-01-21T07:41:56.639821+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.195:0/738644916' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]: dispatch 2024-01-21T07:41:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:56 smithi195 bash[13978]: audit 2024-01-21T07:41:56.641068+0000 mon.a (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]: dispatch 2024-01-21T07:41:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:56 smithi195 bash[13978]: audit 2024-01-21T07:41:56.649819+0000 mon.a (mon.0) 425 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]': finished 2024-01-21T07:41:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:56 smithi195 bash[13978]: cluster 2024-01-21T07:41:56.649927+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-01-21T07:41:57.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:56 smithi195 bash[13978]: audit 2024-01-21T07:41:56.650193+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:41:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[13909]: audit 2024-01-21T07:41:56.639821+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.195:0/738644916' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]: dispatch 2024-01-21T07:41:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[13909]: audit 2024-01-21T07:41:56.641068+0000 mon.a (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]: dispatch 2024-01-21T07:41:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[13909]: audit 2024-01-21T07:41:56.649819+0000 mon.a (mon.0) 425 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]': finished 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[13909]: cluster 2024-01-21T07:41:56.649927+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[13909]: audit 2024-01-21T07:41:56.650193+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[17460]: audit 2024-01-21T07:41:56.639821+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.195:0/738644916' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]: dispatch 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[17460]: audit 2024-01-21T07:41:56.641068+0000 mon.a (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]: dispatch 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[17460]: audit 2024-01-21T07:41:56.649819+0000 mon.a (mon.0) 425 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "77f80413-d084-4cd8-a2d3-37352ceb17a5"}]': finished 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[17460]: cluster 2024-01-21T07:41:56.649927+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-01-21T07:41:57.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:56 smithi080 bash[17460]: audit 2024-01-21T07:41:56.650193+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:41:58.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:57 smithi195 bash[13978]: cluster 2024-01-21T07:41:57.735081+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:58.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:57 smithi080 bash[13909]: cluster 2024-01-21T07:41:57.735081+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:41:58.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:57 smithi080 bash[17460]: cluster 2024-01-21T07:41:57.735081+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:00.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:41:59 smithi080 bash[17460]: audit 2024-01-21T07:41:58.883327+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.195:0/4066754174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:42:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:41:59 smithi080 bash[13909]: audit 2024-01-21T07:41:58.883327+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.195:0/4066754174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:42:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:41:59 smithi195 bash[13978]: audit 2024-01-21T07:41:58.883327+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.195:0/4066754174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-21T07:42:01.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:00 smithi080 bash[17460]: cluster 2024-01-21T07:41:59.735664+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:01.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:00 smithi080 bash[13909]: cluster 2024-01-21T07:41:59.735664+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:01.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:00 smithi195 bash[13978]: cluster 2024-01-21T07:41:59.735664+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:02.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:01 smithi080 bash[17460]: audit 2024-01-21T07:42:01.622010+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:42:02.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:01 smithi080 bash[13909]: audit 2024-01-21T07:42:01.622010+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:42:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:01 smithi195 bash[13978]: audit 2024-01-21T07:42:01.622010+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:42:02.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:02 smithi195 bash[13978]: cluster 2024-01-21T07:42:01.736220+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:03.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:02 smithi080 bash[13909]: cluster 2024-01-21T07:42:01.736220+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:03.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:02 smithi080 bash[17460]: cluster 2024-01-21T07:42:01.736220+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:04 smithi080 bash[13909]: cluster 2024-01-21T07:42:03.736815+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:05.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:04 smithi080 bash[17460]: cluster 2024-01-21T07:42:03.736815+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:05.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:04 smithi195 bash[13978]: cluster 2024-01-21T07:42:03.736815+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:05.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:05 smithi195 bash[13978]: audit 2024-01-21T07:42:05.320468+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-21T07:42:05.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:05 smithi195 bash[13978]: audit 2024-01-21T07:42:05.322354+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:05.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:05 smithi195 bash[13978]: audit 2024-01-21T07:42:05.324373+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-01-21T07:42:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:05 smithi080 bash[13909]: audit 2024-01-21T07:42:05.320468+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-21T07:42:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:05 smithi080 bash[13909]: audit 2024-01-21T07:42:05.322354+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:05 smithi080 bash[13909]: audit 2024-01-21T07:42:05.324373+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-01-21T07:42:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:05 smithi080 bash[17460]: audit 2024-01-21T07:42:05.320468+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-21T07:42:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:05 smithi080 bash[17460]: audit 2024-01-21T07:42:05.322354+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:06.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:05 smithi080 bash[17460]: audit 2024-01-21T07:42:05.324373+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-01-21T07:42:06.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:06 smithi195 bash[13978]: cephadm 2024-01-21T07:42:05.323722+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon osd.7 on smithi195 2024-01-21T07:42:06.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:06 smithi195 bash[13978]: cluster 2024-01-21T07:42:05.737480+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:07.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:06 smithi080 bash[13909]: cephadm 2024-01-21T07:42:05.323722+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon osd.7 on smithi195 2024-01-21T07:42:07.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:06 smithi080 bash[13909]: cluster 2024-01-21T07:42:05.737480+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:07.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:06 smithi080 bash[17460]: cephadm 2024-01-21T07:42:05.323722+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon osd.7 on smithi195 2024-01-21T07:42:07.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:06 smithi080 bash[17460]: cluster 2024-01-21T07:42:05.737480+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:07.517 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 7 on host 'smithi195' 2024-01-21T07:42:07.790 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:07 smithi195 bash[13978]: audit 2024-01-21T07:42:07.504555+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:07.790 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:07 smithi195 bash[13978]: audit 2024-01-21T07:42:07.505735+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:07.791 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:07 smithi195 bash[13978]: audit 2024-01-21T07:42:07.512950+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:08.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:07 smithi080 bash[13909]: audit 2024-01-21T07:42:07.504555+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:08.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:07 smithi080 bash[13909]: audit 2024-01-21T07:42:07.505735+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:08.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:07 smithi080 bash[13909]: audit 2024-01-21T07:42:07.512950+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:08.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:07 smithi080 bash[17460]: audit 2024-01-21T07:42:07.504555+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:08.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:07 smithi080 bash[17460]: audit 2024-01-21T07:42:07.505735+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:08.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:07 smithi080 bash[17460]: audit 2024-01-21T07:42:07.512950+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915259\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915455\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915581\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915702\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:41:41.915821\", \"created\": \"2024-01-21T07:41:40.993249\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_device_update\": \"2024-01-21T07:41:50.609969\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:08.825 DEBUG:teuthology.orchestra.run.smithi195:osd.7> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.7.service 2024-01-21T07:42:08.828 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-01-21T07:42:08.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd stat -f json 2024-01-21T07:42:08.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:08 smithi195 bash[13978]: cluster 2024-01-21T07:42:07.738055+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:08.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:08 smithi195 bash[13978]: audit 2024-01-21T07:42:08.387889+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:08.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:08 smithi195 bash[13978]: audit 2024-01-21T07:42:08.394198+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:08.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:08 smithi195 bash[13978]: audit 2024-01-21T07:42:08.395686+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:42:09.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[13909]: cluster 2024-01-21T07:42:07.738055+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:09.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[17460]: cluster 2024-01-21T07:42:07.738055+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:09.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[13909]: audit 2024-01-21T07:42:08.387889+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:09.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[17460]: audit 2024-01-21T07:42:08.387889+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:09.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[13909]: audit 2024-01-21T07:42:08.394198+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:09.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[13909]: audit 2024-01-21T07:42:08.395686+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:42:09.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[17460]: audit 2024-01-21T07:42:08.394198+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:09.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:08 smithi080 bash[17460]: audit 2024-01-21T07:42:08.395686+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-01-21T07:42:09.706 INFO:journalctl@ceph.osd.7.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:42:10.079 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-21T07:42:10.080 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-01-21T07:42:10.080 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-01-21T07:42:10.080 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-01-21T07:42:10.080 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-01-21T07:42:10.080 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-21T07:42:10.081 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:09 smithi195 bash[20631]: --> ceph-volume lvm activate successful for osd ID: 7 2024-01-21T07:42:10.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:10 smithi195 bash[13978]: cluster 2024-01-21T07:42:09.738745+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:10.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:10 smithi195 bash[13978]: audit 2024-01-21T07:42:09.761856+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:42:10.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:10 smithi195 bash[13978]: audit 2024-01-21T07:42:09.767813+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:42:11.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:10 smithi080 bash[13909]: cluster 2024-01-21T07:42:09.738745+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:11.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:10 smithi080 bash[13909]: audit 2024-01-21T07:42:09.761856+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:42:11.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:10 smithi080 bash[13909]: audit 2024-01-21T07:42:09.767813+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:42:11.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:10 smithi080 bash[17460]: cluster 2024-01-21T07:42:09.738745+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:11.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:10 smithi080 bash[17460]: audit 2024-01-21T07:42:09.761856+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:42:11.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:10 smithi080 bash[17460]: audit 2024-01-21T07:42:09.767813+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:42:11.569 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:42:12.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:11 smithi080 bash[13909]: audit 2024-01-21T07:42:11.567555+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.80:0/3924989144' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:12.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:11 smithi080 bash[13909]: cluster 2024-01-21T07:42:11.739313+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:12.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:11 smithi080 bash[17460]: audit 2024-01-21T07:42:11.567555+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.80:0/3924989144' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:12.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:11 smithi080 bash[17460]: cluster 2024-01-21T07:42:11.739313+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:12.159 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:11 smithi195 bash[13978]: audit 2024-01-21T07:42:11.567555+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.80:0/3924989144' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:12.159 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:11 smithi195 bash[13978]: cluster 2024-01-21T07:42:11.739313+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:12.232 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"num_osds":8,"num_up_osds":7,"osd_up_since":1705822911,"num_in_osds":7,"osd_in_since":1705822911,"num_remapped_pgs":0} 2024-01-21T07:42:13.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd stat -f json 2024-01-21T07:42:13.387 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:13 smithi195 bash[20923]: debug 2024-01-21T07:42:13.060+0000 7fc552913ec0 -1 Falling back to public interface 2024-01-21T07:42:14.137 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:13 smithi195 bash[20923]: debug 2024-01-21T07:42:13.728+0000 7fc552913ec0 -1 osd.7 0 log_to_monitors {default=true} 2024-01-21T07:42:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[13909]: audit 2024-01-21T07:42:13.738594+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-21T07:42:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[13909]: cluster 2024-01-21T07:42:13.739864+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[13909]: audit 2024-01-21T07:42:13.739885+0000 mon.a (mon.0) 440 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-21T07:42:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[13909]: audit 2024-01-21T07:42:14.503693+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[17460]: audit 2024-01-21T07:42:13.738594+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-21T07:42:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[17460]: cluster 2024-01-21T07:42:13.739864+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[17460]: audit 2024-01-21T07:42:13.739885+0000 mon.a (mon.0) 440 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-21T07:42:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:14 smithi080 bash[17460]: audit 2024-01-21T07:42:14.503693+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:15.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:14 smithi195 bash[13978]: audit 2024-01-21T07:42:13.738594+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-21T07:42:15.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:14 smithi195 bash[13978]: cluster 2024-01-21T07:42:13.739864+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:15.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:14 smithi195 bash[13978]: audit 2024-01-21T07:42:13.739885+0000 mon.a (mon.0) 440 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-21T07:42:15.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:14 smithi195 bash[13978]: audit 2024-01-21T07:42:14.503693+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:16.022 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: audit 2024-01-21T07:42:14.731848+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: audit 2024-01-21T07:42:14.738329+0000 mon.a (mon.0) 443 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: cluster 2024-01-21T07:42:14.738412+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: audit 2024-01-21T07:42:14.738962+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: audit 2024-01-21T07:42:14.739552+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: audit 2024-01-21T07:42:14.731848+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: audit 2024-01-21T07:42:14.738329+0000 mon.a (mon.0) 443 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: cluster 2024-01-21T07:42:14.738412+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: audit 2024-01-21T07:42:14.738962+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: audit 2024-01-21T07:42:14.739552+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:42:16.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: audit 2024-01-21T07:42:14.745333+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:16.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[13909]: audit 2024-01-21T07:42:14.746185+0000 mon.a (mon.0) 447 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:42:16.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: audit 2024-01-21T07:42:14.745333+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:16.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:15 smithi080 bash[17460]: audit 2024-01-21T07:42:14.746185+0000 mon.a (mon.0) 447 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:42:16.137 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[20923]: debug 2024-01-21T07:42:15.756+0000 7fc5376c0700 -1 osd.7 0 waiting for initial osdmap 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: audit 2024-01-21T07:42:14.731848+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: audit 2024-01-21T07:42:14.738329+0000 mon.a (mon.0) 443 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: cluster 2024-01-21T07:42:14.738412+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: audit 2024-01-21T07:42:14.738962+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: audit 2024-01-21T07:42:14.739552+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: audit 2024-01-21T07:42:14.745333+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}}, \"last_daemon_update\": \"2024-01-21T07:42:08.386126\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:15 smithi195 bash[13978]: audit 2024-01-21T07:42:14.746185+0000 mon.a (mon.0) 447 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-01-21T07:42:16.756 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"num_osds":8,"num_up_osds":7,"osd_up_since":1705822911,"num_in_osds":7,"osd_in_since":1705822911,"num_remapped_pgs":0} 2024-01-21T07:42:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: cluster 2024-01-21T07:42:14.757742+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:42:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: cluster 2024-01-21T07:42:14.757795+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:42:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: cluster 2024-01-21T07:42:15.740305+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: audit 2024-01-21T07:42:15.753587+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:42:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: cluster 2024-01-21T07:42:15.753651+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: audit 2024-01-21T07:42:15.753834+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[13909]: audit 2024-01-21T07:42:16.021190+0000 mon.a (mon.0) 451 : audit [DBG] from='client.? 172.21.15.80:0/2038589518' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: cluster 2024-01-21T07:42:14.757742+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: cluster 2024-01-21T07:42:14.757795+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: cluster 2024-01-21T07:42:15.740305+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: audit 2024-01-21T07:42:15.753587+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: cluster 2024-01-21T07:42:15.753651+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: audit 2024-01-21T07:42:15.753834+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:17.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:16 smithi080 bash[17460]: audit 2024-01-21T07:42:16.021190+0000 mon.a (mon.0) 451 : audit [DBG] from='client.? 172.21.15.80:0/2038589518' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:17.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: cluster 2024-01-21T07:42:14.757742+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-01-21T07:42:17.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: cluster 2024-01-21T07:42:14.757795+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-01-21T07:42:17.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: cluster 2024-01-21T07:42:15.740305+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:17.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: audit 2024-01-21T07:42:15.753587+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-01-21T07:42:17.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: cluster 2024-01-21T07:42:15.753651+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2024-01-21T07:42:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: audit 2024-01-21T07:42:15.753834+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:16 smithi195 bash[13978]: audit 2024-01-21T07:42:16.021190+0000 mon.a (mon.0) 451 : audit [DBG] from='client.? 172.21.15.80:0/2038589518' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:17.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd stat -f json 2024-01-21T07:42:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[13909]: cluster 2024-01-21T07:42:16.762959+0000 mon.a (mon.0) 452 : cluster [INF] osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592] boot 2024-01-21T07:42:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[13909]: cluster 2024-01-21T07:42:16.763057+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-01-21T07:42:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[13909]: audit 2024-01-21T07:42:16.763268+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[13909]: cluster 2024-01-21T07:42:17.740809+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:18.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[17460]: cluster 2024-01-21T07:42:16.762959+0000 mon.a (mon.0) 452 : cluster [INF] osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592] boot 2024-01-21T07:42:18.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[17460]: cluster 2024-01-21T07:42:16.763057+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-01-21T07:42:18.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[17460]: audit 2024-01-21T07:42:16.763268+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:18.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:17 smithi080 bash[17460]: cluster 2024-01-21T07:42:17.740809+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:18.137 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:42:17 smithi195 bash[19324]: debug 2024-01-21T07:42:17.772+0000 7f0b2d808700 -1 osd.6 49 build_incremental_map_msg missing incremental map 49 2024-01-21T07:42:18.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:17 smithi195 bash[13978]: cluster 2024-01-21T07:42:16.762959+0000 mon.a (mon.0) 452 : cluster [INF] osd.7 [v2:172.21.15.195:6824/768760592,v1:172.21.15.195:6825/768760592] boot 2024-01-21T07:42:18.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:17 smithi195 bash[13978]: cluster 2024-01-21T07:42:16.763057+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-01-21T07:42:18.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:17 smithi195 bash[13978]: audit 2024-01-21T07:42:16.763268+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:42:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:17 smithi195 bash[13978]: cluster 2024-01-21T07:42:17.740809+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2024-01-21T07:42:18.960 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:18 smithi080 bash[13909]: cluster 2024-01-21T07:42:17.774028+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-01-21T07:42:18.961 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:18 smithi080 bash[17460]: cluster 2024-01-21T07:42:17.774028+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-01-21T07:42:19.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:18 smithi195 bash[13978]: cluster 2024-01-21T07:42:17.774028+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-01-21T07:42:20.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:19 smithi080 bash[13909]: cluster 2024-01-21T07:42:19.741460+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v187: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:20.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:19 smithi080 bash[17460]: cluster 2024-01-21T07:42:19.741460+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v187: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:20.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:19 smithi195 bash[13978]: cluster 2024-01-21T07:42:19.741460+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v187: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:20.517 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:42:21.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:20 smithi080 bash[13909]: cluster 2024-01-21T07:42:19.772807+0000 mon.a (mon.0) 456 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:42:21.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:20 smithi080 bash[13909]: audit 2024-01-21T07:42:20.515835+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.80:0/3112507793' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:21.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:20 smithi080 bash[17460]: cluster 2024-01-21T07:42:19.772807+0000 mon.a (mon.0) 456 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:42:21.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:20 smithi080 bash[17460]: audit 2024-01-21T07:42:20.515835+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.80:0/3112507793' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:21.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:20 smithi195 bash[13978]: cluster 2024-01-21T07:42:19.772807+0000 mon.a (mon.0) 456 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-21T07:42:21.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:20 smithi195 bash[13978]: audit 2024-01-21T07:42:20.515835+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.80:0/3112507793' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-21T07:42:21.252 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1705822936,"num_in_osds":8,"osd_in_since":1705822936,"num_remapped_pgs":0} 2024-01-21T07:42:21.252 INFO:tasks.cephadm:Adding prometheus.a on smithi195 2024-01-21T07:42:21.253 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch apply prometheus '1;smithi195=a' 2024-01-21T07:42:22.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:21 smithi080 bash[13909]: cluster 2024-01-21T07:42:21.742166+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v188: 1 pgs: 1 peering; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:22.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:21 smithi080 bash[17460]: cluster 2024-01-21T07:42:21.742166+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v188: 1 pgs: 1 peering; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:22.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:21 smithi195 bash[13978]: cluster 2024-01-21T07:42:21.742166+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v188: 1 pgs: 1 peering; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:24.222 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled prometheus update... 2024-01-21T07:42:24.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:24 smithi195 bash[13978]: cluster 2024-01-21T07:42:23.742735+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:24.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:24 smithi195 bash[13978]: audit 2024-01-21T07:42:24.206142+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-01-21T07:42:24.205473\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-01-21T07:42:24.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:24 smithi195 bash[13978]: audit 2024-01-21T07:42:24.211815+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-01-21T07:42:24.205473\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-01-21T07:42:25.049 DEBUG:teuthology.orchestra.run.smithi195:prometheus.a> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@prometheus.a.service 2024-01-21T07:42:25.052 INFO:tasks.cephadm:Adding node-exporter.a on smithi080 2024-01-21T07:42:25.052 INFO:tasks.cephadm:Adding node-exporter.b on smithi195 2024-01-21T07:42:25.052 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch apply node-exporter '2;smithi080=a;smithi195=b' 2024-01-21T07:42:25.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:24 smithi080 bash[13909]: cluster 2024-01-21T07:42:23.742735+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:25.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:24 smithi080 bash[13909]: audit 2024-01-21T07:42:24.206142+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-01-21T07:42:24.205473\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-01-21T07:42:25.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:24 smithi080 bash[13909]: audit 2024-01-21T07:42:24.211815+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-01-21T07:42:24.205473\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-01-21T07:42:25.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:24 smithi080 bash[17460]: cluster 2024-01-21T07:42:23.742735+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:25.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:24 smithi080 bash[17460]: audit 2024-01-21T07:42:24.206142+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-01-21T07:42:24.205473\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-01-21T07:42:25.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:24 smithi080 bash[17460]: audit 2024-01-21T07:42:24.211815+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-01-21T07:42:24.205473\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-01-21T07:42:25.722 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:42:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: audit 2024-01-21T07:42:24.204421+0000 mgr.y (mgr.14140) 182 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi195=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: cephadm 2024-01-21T07:42:24.205449+0000 mgr.y (mgr.14140) 183 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi195=a 2024-01-21T07:42:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: cephadm 2024-01-21T07:42:24.220040+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: cluster 2024-01-21T07:42:24.728877+0000 mon.a (mon.0) 459 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: cluster 2024-01-21T07:42:24.728944+0000 mon.a (mon.0) 460 : cluster [INF] Cluster is now healthy 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: audit 2024-01-21T07:42:24.769671+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822936.7615461, \"finished_at\": 1705822944.738381}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[13909]: audit 2024-01-21T07:42:24.775063+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822936.7615461, \"finished_at\": 1705822944.738381}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: audit 2024-01-21T07:42:24.204421+0000 mgr.y (mgr.14140) 182 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi195=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: cephadm 2024-01-21T07:42:24.205449+0000 mgr.y (mgr.14140) 183 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi195=a 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: cephadm 2024-01-21T07:42:24.220040+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: cluster 2024-01-21T07:42:24.728877+0000 mon.a (mon.0) 459 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: cluster 2024-01-21T07:42:24.728944+0000 mon.a (mon.0) 460 : cluster [INF] Cluster is now healthy 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: audit 2024-01-21T07:42:24.769671+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822936.7615461, \"finished_at\": 1705822944.738381}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:42:26.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:25 smithi080 bash[17460]: audit 2024-01-21T07:42:24.775063+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822936.7615461, \"finished_at\": 1705822944.738381}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: audit 2024-01-21T07:42:24.204421+0000 mgr.y (mgr.14140) 182 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi195=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: cephadm 2024-01-21T07:42:24.205449+0000 mgr.y (mgr.14140) 183 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi195=a 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: cephadm 2024-01-21T07:42:24.220040+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: cluster 2024-01-21T07:42:24.728877+0000 mon.a (mon.0) 459 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: cluster 2024-01-21T07:42:24.728944+0000 mon.a (mon.0) 460 : cluster [INF] Cluster is now healthy 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: audit 2024-01-21T07:42:24.769671+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822936.7615461, \"finished_at\": 1705822944.738381}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:42:26.073 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:25 smithi195 bash[13978]: audit 2024-01-21T07:42:24.775063+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822858.7838347, \"finished_at\": 1705822875.3510861}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822884.8303626, \"finished_at\": 1705822901.0314648}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822911.7721117, \"finished_at\": 1705822927.5239966}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822936.7615461, \"finished_at\": 1705822944.738381}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:42:27.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:26 smithi080 bash[13909]: cluster 2024-01-21T07:42:25.743317+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:27.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:26 smithi080 bash[17460]: cluster 2024-01-21T07:42:25.743317+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:27.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:26 smithi195 bash[13978]: cluster 2024-01-21T07:42:25.743317+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:28.030 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled node-exporter update... 2024-01-21T07:42:28.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: debug 2024-01-21T07:42:28.308+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:28.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:28.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:28.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:28.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:28.762 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:28.763 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:28.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[17460]: cluster 2024-01-21T07:42:27.743968+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:28.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[17460]: audit 2024-01-21T07:42:28.020592+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-01-21T07:42:28.019844\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-01-21T07:42:28.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[17460]: audit 2024-01-21T07:42:28.026663+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-01-21T07:42:28.019844\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-01-21T07:42:28.765 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[13909]: cluster 2024-01-21T07:42:27.743968+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:28.765 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[13909]: audit 2024-01-21T07:42:28.020592+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-01-21T07:42:28.019844\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-01-21T07:42:28.765 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:28 smithi080 bash[13909]: audit 2024-01-21T07:42:28.026663+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-01-21T07:42:28.019844\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-01-21T07:42:28.805 DEBUG:teuthology.orchestra.run.smithi080:node-exporter.a> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service 2024-01-21T07:42:28.807 DEBUG:teuthology.orchestra.run.smithi195:node-exporter.b> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service 2024-01-21T07:42:28.809 INFO:tasks.cephadm:Adding alertmanager.a on smithi080 2024-01-21T07:42:28.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch apply alertmanager '1;smithi080=a' 2024-01-21T07:42:28.939 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:42:28.966 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:42:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:28 smithi195 bash[13978]: cluster 2024-01-21T07:42:27.743968+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:28 smithi195 bash[13978]: audit 2024-01-21T07:42:28.020592+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-01-21T07:42:28.019844\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-01-21T07:42:29.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:28 smithi195 bash[13978]: audit 2024-01-21T07:42:28.026663+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-01-21T07:42:28.019844\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi195\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: audit 2024-01-21T07:42:28.018683+0000 mgr.y (mgr.14140) 187 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi195=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: cephadm 2024-01-21T07:42:28.019812+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi080=a,smithi195=b 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: cephadm 2024-01-21T07:42:28.312384+0000 mgr.y (mgr.14140) 189 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:30.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: audit 2024-01-21T07:42:28.018683+0000 mgr.y (mgr.14140) 187 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi195=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: cephadm 2024-01-21T07:42:28.019812+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi080=a,smithi195=b 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: cephadm 2024-01-21T07:42:28.312384+0000 mgr.y (mgr.14140) 189 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: cephadm 2024-01-21T07:42:28.312693+0000 mgr.y (mgr.14140) 190 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[17460]: cephadm 2024-01-21T07:42:28.319331+0000 mgr.y (mgr.14140) 191 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:30.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: cephadm 2024-01-21T07:42:28.312693+0000 mgr.y (mgr.14140) 190 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:30.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:29 smithi080 bash[13909]: cephadm 2024-01-21T07:42:28.319331+0000 mgr.y (mgr.14140) 191 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: audit 2024-01-21T07:42:28.018683+0000 mgr.y (mgr.14140) 187 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi195=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: cephadm 2024-01-21T07:42:28.019812+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi080=a,smithi195=b 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: cephadm 2024-01-21T07:42:28.312384+0000 mgr.y (mgr.14140) 189 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:30.083 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:30.085 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: cephadm 2024-01-21T07:42:28.312693+0000 mgr.y (mgr.14140) 190 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr latest: Pulling from prom/prometheus 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:30.086 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:30.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:30.087 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:29 smithi195 bash[13978]: cephadm 2024-01-21T07:42:28.319331+0000 mgr.y (mgr.14140) 191 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:30.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:30 smithi195 bash[13978]: cluster 2024-01-21T07:42:29.744544+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:31.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:30 smithi080 bash[13909]: cluster 2024-01-21T07:42:29.744544+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:31.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:30 smithi080 bash[17460]: cluster 2024-01-21T07:42:29.744544+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:31.770 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: debug 2024-01-21T07:42:31.308+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:31.770 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:31.771 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:31.772 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:31.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:31.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:31.773 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:31.810 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled alertmanager update... 2024-01-21T07:42:32.028 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:32 smithi080 docker[25266]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.a 2024-01-21T07:42:32.028 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:32 smithi080 systemd[1]: Started Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:32.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: cephadm 2024-01-21T07:42:31.313411+0000 mgr.y (mgr.14140) 193 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:32.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: cephadm 2024-01-21T07:42:31.313411+0000 mgr.y (mgr.14140) 193 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:32.031 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.032 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:32.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: cephadm 2024-01-21T07:42:31.313663+0000 mgr.y (mgr.14140) 194 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:32.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: audit 2024-01-21T07:42:31.315119+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: audit 2024-01-21T07:42:31.317042+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: cephadm 2024-01-21T07:42:31.318764+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[17460]: cluster 2024-01-21T07:42:31.745196+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:32.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: cephadm 2024-01-21T07:42:31.313663+0000 mgr.y (mgr.14140) 194 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:32.036 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:32.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: audit 2024-01-21T07:42:31.315119+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-01-21T07:42:32.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: audit 2024-01-21T07:42:31.317042+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:32.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: cephadm 2024-01-21T07:42:31.318764+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-01-21T07:42:32.037 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:31 smithi080 bash[13909]: cluster 2024-01-21T07:42:31.745196+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: cephadm 2024-01-21T07:42:31.313411+0000 mgr.y (mgr.14140) 193 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:32.041 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.042 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:32.043 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: cephadm 2024-01-21T07:42:31.313663+0000 mgr.y (mgr.14140) 194 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:32.044 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:32.045 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:32.045 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:32.045 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: audit 2024-01-21T07:42:31.315119+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-01-21T07:42:32.045 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: audit 2024-01-21T07:42:31.317042+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:32.045 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: cephadm 2024-01-21T07:42:31.318764+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-01-21T07:42:32.045 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:31 smithi195 bash[13978]: cluster 2024-01-21T07:42:31.745196+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:32.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[25286]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:42:32.553 DEBUG:teuthology.orchestra.run.smithi080:alertmanager.a> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@alertmanager.a.service 2024-01-21T07:42:32.556 INFO:tasks.cephadm:Adding grafana.a on smithi195 2024-01-21T07:42:32.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph orch apply grafana '1;smithi195=a' 2024-01-21T07:42:32.584 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:42:32.872 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:32 smithi195 docker[21873]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:42:32.873 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:32 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:33.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:31.800849+0000 mgr.y (mgr.14140) 197 : audit [DBG] from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: cephadm 2024-01-21T07:42:31.801469+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi080=a 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:31.801886+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-01-21T07:42:31.801489\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:31.807436+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-01-21T07:42:31.801489\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:31.800849+0000 mgr.y (mgr.14140) 197 : audit [DBG] from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: cephadm 2024-01-21T07:42:31.801469+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi080=a 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:31.801886+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-01-21T07:42:31.801489\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-01-21T07:42:33.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:31.807436+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-01-21T07:42:31.801489\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-01-21T07:42:33.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.021807+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:42:33.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.025505+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:42:33.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.026206+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-01-21T07:42:33.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.027783+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:33.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: cephadm 2024-01-21T07:42:32.028525+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Deploying daemon node-exporter.b on smithi195 2024-01-21T07:42:33.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.021807+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:42:33.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.727885+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:33.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.733979+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:33.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[17460]: audit 2024-01-21T07:42:32.735647+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.025505+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.026206+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.027783+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: cephadm 2024-01-21T07:42:32.028525+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Deploying daemon node-exporter.b on smithi195 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.727885+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.733979+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:33.062 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:32 smithi080 bash[13909]: audit 2024-01-21T07:42:32.735647+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:33.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:31.800849+0000 mgr.y (mgr.14140) 197 : audit [DBG] from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:33.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: cephadm 2024-01-21T07:42:31.801469+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi080=a 2024-01-21T07:42:33.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:31.801886+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-01-21T07:42:31.801489\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-01-21T07:42:33.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:31.807436+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-01-21T07:42:31.801489\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-01-21T07:42:33.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.021807+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.025505+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040173\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040344\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040446\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040543\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040639\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040734\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:40:29.040830\", \"created\": \"2024-01-21T07:40:28.143163\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.026206+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.027783+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: cephadm 2024-01-21T07:42:32.028525+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Deploying daemon node-exporter.b on smithi195 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.727885+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.733979+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385245\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385446\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385572\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385693\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385812\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:08.385932\", \"created\": \"2024-01-21T07:42:07.484653\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:33.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[13978]: audit 2024-01-21T07:42:32.735647+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:33.139 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:32 smithi195 bash[21890]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:42:34.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[17460]: audit 2024-01-21T07:42:33.468523+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_daemon_update\": \"2024-01-21T07:42:33.466870\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:42:34.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[17460]: audit 2024-01-21T07:42:33.473106+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_daemon_update\": \"2024-01-21T07:42:33.466870\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:42:34.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[17460]: audit 2024-01-21T07:42:33.474471+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:34.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[17460]: cluster 2024-01-21T07:42:33.745851+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:34.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[13909]: audit 2024-01-21T07:42:33.468523+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_daemon_update\": \"2024-01-21T07:42:33.466870\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:42:34.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[13909]: audit 2024-01-21T07:42:33.473106+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_daemon_update\": \"2024-01-21T07:42:33.466870\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:42:34.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[13909]: audit 2024-01-21T07:42:33.474471+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:34.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:33 smithi080 bash[13909]: cluster 2024-01-21T07:42:33.745851+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:34.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:33 smithi195 bash[13978]: audit 2024-01-21T07:42:33.468523+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_daemon_update\": \"2024-01-21T07:42:33.466870\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:42:34.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:33 smithi195 bash[13978]: audit 2024-01-21T07:42:33.473106+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}}, \"last_daemon_update\": \"2024-01-21T07:42:33.466870\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:42:34.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:33 smithi195 bash[13978]: audit 2024-01-21T07:42:33.474471+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:42:34.084 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:33 smithi195 bash[13978]: cluster 2024-01-21T07:42:33.745851+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:34.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:34 smithi195 bash[21890]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:34.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:34 smithi195 bash[21890]: See 'docker run --help'. 2024-01-21T07:42:34.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:34 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:42:34.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:34 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:42:35.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:34 smithi080 bash[13909]: audit 2024-01-21T07:42:34.225844+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_daemon_update\": \"2024-01-21T07:42:34.223989\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:35.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:34 smithi080 bash[13909]: audit 2024-01-21T07:42:34.231774+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_daemon_update\": \"2024-01-21T07:42:34.223989\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:35.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:34 smithi080 bash[13909]: cephadm 2024-01-21T07:42:34.238931+0000 mgr.y (mgr.14140) 201 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:35.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:34 smithi080 bash[17460]: audit 2024-01-21T07:42:34.225844+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_daemon_update\": \"2024-01-21T07:42:34.223989\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:35.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:34 smithi080 bash[17460]: audit 2024-01-21T07:42:34.231774+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_daemon_update\": \"2024-01-21T07:42:34.223989\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:35.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:34 smithi080 bash[17460]: cephadm 2024-01-21T07:42:34.238931+0000 mgr.y (mgr.14140) 201 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:35.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:34 smithi195 bash[13978]: audit 2024-01-21T07:42:34.225844+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_daemon_update\": \"2024-01-21T07:42:34.223989\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:42:35.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:34 smithi195 bash[13978]: audit 2024-01-21T07:42:34.231774+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}}, \"last_daemon_update\": \"2024-01-21T07:42:34.223989\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:42:35.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:34 smithi195 bash[13978]: cephadm 2024-01-21T07:42:34.238931+0000 mgr.y (mgr.14140) 201 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:35.800 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:35 smithi080 bash[25286]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:35.800 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:35 smithi080 bash[25286]: See 'docker run --help'. 2024-01-21T07:42:35.800 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:35 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:42:35.801 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:35 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-21T07:42:35.840 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled grafana update... 2024-01-21T07:42:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:35 smithi080 bash[13909]: cluster 2024-01-21T07:42:35.746415+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:36.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:35 smithi080 bash[17460]: cluster 2024-01-21T07:42:35.746415+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:36.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:35 smithi195 bash[13978]: cluster 2024-01-21T07:42:35.746415+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:36.517 DEBUG:teuthology.orchestra.run.smithi195:grafana.a> sudo journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@grafana.a.service 2024-01-21T07:42:36.519 INFO:tasks.cephadm:Setting up client nodes... 2024-01-21T07:42:36.519 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-01-21T07:42:36.580 INFO:journalctl@ceph.grafana.a.smithi195.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-01-21T07:42:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[13909]: audit 2024-01-21T07:42:35.829677+0000 mgr.y (mgr.14140) 203 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi195=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[13909]: cephadm 2024-01-21T07:42:35.830739+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Saving service grafana spec with placement count:1 smithi195=a 2024-01-21T07:42:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[13909]: audit 2024-01-21T07:42:35.831431+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-01-21T07:42:35.830764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-01-21T07:42:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[13909]: audit 2024-01-21T07:42:35.837334+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-01-21T07:42:35.830764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-01-21T07:42:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[17460]: audit 2024-01-21T07:42:35.829677+0000 mgr.y (mgr.14140) 203 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi195=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[17460]: cephadm 2024-01-21T07:42:35.830739+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Saving service grafana spec with placement count:1 smithi195=a 2024-01-21T07:42:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[17460]: audit 2024-01-21T07:42:35.831431+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-01-21T07:42:35.830764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-01-21T07:42:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:36 smithi080 bash[17460]: audit 2024-01-21T07:42:35.837334+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-01-21T07:42:35.830764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-01-21T07:42:37.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:36 smithi195 bash[13978]: audit 2024-01-21T07:42:35.829677+0000 mgr.y (mgr.14140) 203 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi195=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:42:37.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:36 smithi195 bash[13978]: cephadm 2024-01-21T07:42:35.830739+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Saving service grafana spec with placement count:1 smithi195=a 2024-01-21T07:42:37.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:36 smithi195 bash[13978]: audit 2024-01-21T07:42:35.831431+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-01-21T07:42:35.830764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-01-21T07:42:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:36 smithi195 bash[13978]: audit 2024-01-21T07:42:35.837334+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-01-21T07:42:35.830764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi195\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-01-21T07:42:37.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:37 smithi195 bash[13978]: cluster 2024-01-21T07:42:37.746941+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:38.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:37 smithi080 bash[13909]: cluster 2024-01-21T07:42:37.746941+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:38.047 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:37 smithi080 bash[17460]: cluster 2024-01-21T07:42:37.746941+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:38.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: debug 2024-01-21T07:42:38.040+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:38.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:38.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:38.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:38.312 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:38.312 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:38 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:39.532 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-01-21T07:42:39.532 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDvyqxl490/HxAA/v4xecWLGv/2zipjVgQhtw== 2024-01-21T07:42:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: cephadm 2024-01-21T07:42:38.045250+0000 mgr.y (mgr.14140) 206 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: cephadm 2024-01-21T07:42:38.045250+0000 mgr.y (mgr.14140) 206 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:40.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: cephadm 2024-01-21T07:42:38.045548+0000 mgr.y (mgr.14140) 207 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: cephadm 2024-01-21T07:42:38.052069+0000 mgr.y (mgr.14140) 208 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: audit 2024-01-21T07:42:39.523251+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.80:0/1386490308' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: audit 2024-01-21T07:42:39.523942+0000 mon.a (mon.0) 483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:40.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[13909]: audit 2024-01-21T07:42:39.530590+0000 mon.a (mon.0) 484 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: cephadm 2024-01-21T07:42:38.045548+0000 mgr.y (mgr.14140) 207 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: cephadm 2024-01-21T07:42:38.052069+0000 mgr.y (mgr.14140) 208 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:42:40.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: audit 2024-01-21T07:42:39.523251+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.80:0/1386490308' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:40.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: audit 2024-01-21T07:42:39.523942+0000 mon.a (mon.0) 483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:40.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:39 smithi080 bash[17460]: audit 2024-01-21T07:42:39.530590+0000 mon.a (mon.0) 484 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: cephadm 2024-01-21T07:42:38.045250+0000 mgr.y (mgr.14140) 206 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:40.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: cephadm 2024-01-21T07:42:38.045548+0000 mgr.y (mgr.14140) 207 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: cephadm 2024-01-21T07:42:38.052069+0000 mgr.y (mgr.14140) 208 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: audit 2024-01-21T07:42:39.523251+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.80:0/1386490308' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:40.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: audit 2024-01-21T07:42:39.523942+0000 mon.a (mon.0) 483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:40.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:39 smithi195 bash[13978]: audit 2024-01-21T07:42:39.530590+0000 mon.a (mon.0) 484 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-21T07:42:40.290 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-01-21T07:42:40.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-01-21T07:42:40.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-21T07:42:40.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-01-21T07:42:41.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:40 smithi080 bash[13909]: cluster 2024-01-21T07:42:39.747361+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:41.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:40 smithi080 bash[17460]: cluster 2024-01-21T07:42:39.747361+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:41.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:40 smithi195 bash[13978]: cluster 2024-01-21T07:42:39.747361+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: debug 2024-01-21T07:42:41.840+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:42.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:42.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:42.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:41 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:42 smithi080 bash[17460]: cluster 2024-01-21T07:42:41.747918+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:43.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:42 smithi080 bash[13909]: cluster 2024-01-21T07:42:41.747918+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:43.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:42 smithi195 bash[13978]: cluster 2024-01-21T07:42:41.747918+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:43.300 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-01-21T07:42:43.300 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDzyqxlMu1dERAAffpTGxlbiRpU4c2uD/sLlQ== 2024-01-21T07:42:43.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: cephadm 2024-01-21T07:42:41.844020+0000 mgr.y (mgr.14140) 211 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:43.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:43.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:43.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:43.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:43.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:43.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:43.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:43.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:43.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:43.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:43.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:43.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:43.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: cephadm 2024-01-21T07:42:41.844431+0000 mgr.y (mgr.14140) 212 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:43.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:43.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: cephadm 2024-01-21T07:42:41.851523+0000 mgr.y (mgr.14140) 213 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:43.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: audit 2024-01-21T07:42:43.289594+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.195:0/1266827151' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:43.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: audit 2024-01-21T07:42:43.291011+0000 mon.a (mon.0) 485 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:43.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:43 smithi195 bash[13978]: audit 2024-01-21T07:42:43.298329+0000 mon.a (mon.0) 486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-21T07:42:44.029 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-21T07:42:44.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-01-21T07:42:44.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-21T07:42:44.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd dump --format=json 2024-01-21T07:42:44.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: cephadm 2024-01-21T07:42:41.844020+0000 mgr.y (mgr.14140) 211 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:44.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:44.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: cephadm 2024-01-21T07:42:41.844431+0000 mgr.y (mgr.14140) 212 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:44.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: cephadm 2024-01-21T07:42:41.851523+0000 mgr.y (mgr.14140) 213 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: audit 2024-01-21T07:42:43.289594+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.195:0/1266827151' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:44.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: audit 2024-01-21T07:42:43.291011+0000 mon.a (mon.0) 485 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[17460]: audit 2024-01-21T07:42:43.298329+0000 mon.a (mon.0) 486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: cephadm 2024-01-21T07:42:41.844020+0000 mgr.y (mgr.14140) 211 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:44.063 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:44.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: cephadm 2024-01-21T07:42:41.844431+0000 mgr.y (mgr.14140) 212 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:44.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:44.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:44.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: cephadm 2024-01-21T07:42:41.851523+0000 mgr.y (mgr.14140) 213 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:42:44.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: audit 2024-01-21T07:42:43.289594+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.195:0/1266827151' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:44.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: audit 2024-01-21T07:42:43.291011+0000 mon.a (mon.0) 485 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-21T07:42:44.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:43 smithi080 bash[13909]: audit 2024-01-21T07:42:43.298329+0000 mon.a (mon.0) 486 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-21T07:42:44.769 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:44 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 1. 2024-01-21T07:42:44.769 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:44 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:44.769 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:44 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:42:44.769 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:44 smithi195 docker[22415]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:42:44.769 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:44 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:44.770 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:44 smithi195 bash[22425]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:42:45.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:44 smithi080 bash[13909]: cluster 2024-01-21T07:42:43.748479+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:45.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:44 smithi080 bash[17460]: cluster 2024-01-21T07:42:43.748479+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:45.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:44 smithi195 bash[13978]: cluster 2024-01-21T07:42:43.748479+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:45.720 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:45 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Scheduled restart job, restart counter is at 1. 2024-01-21T07:42:45.720 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:45 smithi080 systemd[1]: Stopped Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:45.720 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:45 smithi080 systemd[1]: Starting Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:42:45.720 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:45 smithi080 docker[25705]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.a 2024-01-21T07:42:45.720 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:45 smithi080 systemd[1]: Started Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:45.720 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[25717]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:42:45.887 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[22425]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:45.887 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[22425]: See 'docker run --help'. 2024-01-21T07:42:45.887 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:45 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:42:45.887 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:45 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:42:45.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: cephadm 2024-01-21T07:42:45.718416+0000 mgr.y (mgr.14140) 215 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:45.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:45.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:45.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:45.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:45.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:45.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: cephadm 2024-01-21T07:42:45.718687+0000 mgr.y (mgr.14140) 216 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:45.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: cephadm 2024-01-21T07:42:45.726130+0000 mgr.y (mgr.14140) 217 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:42:45.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:45 smithi195 bash[13978]: cluster 2024-01-21T07:42:45.749144+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: cephadm 2024-01-21T07:42:45.718416+0000 mgr.y (mgr.14140) 215 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: debug 2024-01-21T07:42:45.712+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:46.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: cephadm 2024-01-21T07:42:45.718687+0000 mgr.y (mgr.14140) 216 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: cephadm 2024-01-21T07:42:45.726130+0000 mgr.y (mgr.14140) 217 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[13909]: cluster 2024-01-21T07:42:45.749144+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: cephadm 2024-01-21T07:42:45.718416+0000 mgr.y (mgr.14140) 215 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:46.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: cephadm 2024-01-21T07:42:45.718687+0000 mgr.y (mgr.14140) 216 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:46.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:46.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:42:46.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: cephadm 2024-01-21T07:42:45.726130+0000 mgr.y (mgr.14140) 217 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:42:46.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:45 smithi080 bash[17460]: cluster 2024-01-21T07:42:45.749144+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:47.010 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:42:47.010 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":49,"fsid":"b86415d2-b82f-11ee-95b0-87774f69a715","created":"2024-01-21T07:36:42.230921+0000","modified":"2024-01-21T07:42:17.759082+0000","last_up_change":"2024-01-21T07:42:16.744711+0000","last_in_change":"2024-01-21T07:42:16.744711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T07:36:55.297510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9ef0e6e3-19f4-49c4-9074-c94be9e385bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6803","nonce":440522277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6805","nonce":440522277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6809","nonce":440522277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6807","nonce":440522277}]},"public_addr":"172.21.15.80:6803/440522277","cluster_addr":"172.21.15.80:6805/440522277","heartbeat_back_addr":"172.21.15.80:6809/440522277","heartbeat_front_addr":"172.21.15.80:6807/440522277","state":["exists","up"]},{"osd":1,"uuid":"e40c68c3-96c6-45e5-875a-cd0b65d215ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6811","nonce":4131031317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6813","nonce":4131031317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6817","nonce":4131031317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6815","nonce":4131031317}]},"public_addr":"172.21.15.80:6811/4131031317","cluster_addr":"172.21.15.80:6813/4131031317","heartbeat_back_addr":"172.21.15.80:6817/4131031317","heartbeat_front_addr":"172.21.15.80:6815/4131031317","state":["exists","up"]},{"osd":2,"uuid":"8761092d-c3ee-4a24-9d86-39182ffb54e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6819","nonce":1036175868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6821","nonce":1036175868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6825","nonce":1036175868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6823","nonce":1036175868}]},"public_addr":"172.21.15.80:6819/1036175868","cluster_addr":"172.21.15.80:6821/1036175868","heartbeat_back_addr":"172.21.15.80:6825/1036175868","heartbeat_front_addr":"172.21.15.80:6823/1036175868","state":["exists","up"]},{"osd":3,"uuid":"1daf8576-7e1e-44cc-8477-c8108442dd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6827","nonce":1868846440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6829","nonce":1868846440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6833","nonce":1868846440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6831","nonce":1868846440}]},"public_addr":"172.21.15.80:6827/1868846440","cluster_addr":"172.21.15.80:6829/1868846440","heartbeat_back_addr":"172.21.15.80:6833/1868846440","heartbeat_front_addr":"172.21.15.80:6831/1868846440","state":["exists","up"]},{"osd":4,"uuid":"a2c86a3c-7c72-4f55-bf73-9ec14d925b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6801","nonce":2703158768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6803","nonce":2703158768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6807","nonce":2703158768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6805","nonce":2703158768}]},"public_addr":"172.21.15.195:6801/2703158768","cluster_addr":"172.21.15.195:6803/2703158768","heartbeat_back_addr":"172.21.15.195:6807/2703158768","heartbeat_front_addr":"172.21.15.195:6805/2703158768","state":["exists","up"]},{"osd":5,"uuid":"20fb8ae4-0923-4d21-936c-8c8ebbc279f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6809","nonce":1748131419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6811","nonce":1748131419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6815","nonce":1748131419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6813","nonce":1748131419}]},"public_addr":"172.21.15.195:6809/1748131419","cluster_addr":"172.21.15.195:6811/1748131419","heartbeat_back_addr":"172.21.15.195:6815/1748131419","heartbeat_front_addr":"172.21.15.195:6813/1748131419","state":["exists","up"]},{"osd":6,"uuid":"3e78aad1-ff7d-47d1-aabf-a437f0a10df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6817","nonce":129712859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6819","nonce":129712859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6823","nonce":129712859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6821","nonce":129712859}]},"public_addr":"172.21.15.195:6817/129712859","cluster_addr":"172.21.15.195:6819/129712859","heartbeat_back_addr":"172.21.15.195:6823/129712859","heartbeat_front_addr":"172.21.15.195:6821/129712859","state":["exists","up"]},{"osd":7,"uuid":"77f80413-d084-4cd8-a2d3-37352ceb17a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6825","nonce":768760592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6827","nonce":768760592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6831","nonce":768760592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6829","nonce":768760592}]},"public_addr":"172.21.15.195:6825/768760592","cluster_addr":"172.21.15.195:6827/768760592","heartbeat_back_addr":"172.21.15.195:6831/768760592","heartbeat_front_addr":"172.21.15.195:6829/768760592","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:39:17.380267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:39:43.857337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:09.754817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:35.260189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:56.755201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:41:23.441276+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:41:50.009201+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:42:14.757799+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.80:6800/1935270641":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/2682865589":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/876829809":"2024-01-22T07:37:18.988155+0000","172.21.15.80:6800/941119075":"2024-01-22T07:37:02.648111+0000","172.21.15.80:6801/1935270641":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/3112152988":"2024-01-22T07:37:02.648111+0000","172.21.15.80:0/927839510":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/1525539124":"2024-01-22T07:37:02.648111+0000","172.21.15.80:6801/941119075":"2024-01-22T07:37:02.648111+0000","172.21.15.80:0/2682426603":"2024-01-22T07:37:02.648111+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-01-21T07:42:47.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:47 smithi195 bash[13978]: audit 2024-01-21T07:42:47.007148+0000 mon.a (mon.0) 487 : audit [DBG] from='client.? 172.21.15.80:0/4100983362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:42:47.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:47 smithi080 bash[13909]: audit 2024-01-21T07:42:47.007148+0000 mon.a (mon.0) 487 : audit [DBG] from='client.? 172.21.15.80:0/4100983362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:42:47.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:47 smithi080 bash[17460]: audit 2024-01-21T07:42:47.007148+0000 mon.a (mon.0) 487 : audit [DBG] from='client.? 172.21.15.80:0/4100983362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:42:47.740 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T07:36:55.297510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-01-21T07:42:47.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-01-21T07:42:48.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:48 smithi080 bash[13909]: cluster 2024-01-21T07:42:47.749789+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:48.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:48 smithi080 bash[17460]: cluster 2024-01-21T07:42:47.749789+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:48.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:48 smithi195 bash[13978]: cluster 2024-01-21T07:42:47.749789+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:50.058 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[25717]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.058 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[25717]: See 'docker run --help'. 2024-01-21T07:42:50.058 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:49 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:42:50.058 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:49 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: cephadm 2024-01-21T07:42:49.736691+0000 mgr.y (mgr.14140) 220 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:50.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: debug 2024-01-21T07:42:49.732+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: cephadm 2024-01-21T07:42:49.736929+0000 mgr.y (mgr.14140) 221 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.066 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[13909]: cluster 2024-01-21T07:42:49.750177+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: cephadm 2024-01-21T07:42:49.736691+0000 mgr.y (mgr.14140) 220 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:50.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:42:50.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:50.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:50.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: cephadm 2024-01-21T07:42:49.736929+0000 mgr.y (mgr.14140) 221 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.070 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:42:50.071 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.072 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.072 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.072 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:42:50.072 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:42:50.072 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.072 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:49 smithi080 bash[17460]: cluster 2024-01-21T07:42:49.750177+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: cephadm 2024-01-21T07:42:49.736691+0000 mgr.y (mgr.14140) 220 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: cephadm 2024-01-21T07:42:49.736929+0000 mgr.y (mgr.14140) 221 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:42:50.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:42:50.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:49 smithi195 bash[13978]: cluster 2024-01-21T07:42:49.750177+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:51.027 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-01-21T07:42:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[17460]: audit 2024-01-21T07:42:49.890981+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDVRPLSXuFLxJRZFcAA8a1ZMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMTIxMDc0MjQ5WhcN\nMzQwMTE4MDc0MjQ5WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsqYjVXPlC303twwKXfnS\nB2vwT+Cs2qISFL6KY1P052hc9zyYVymWjvYoc0lYVzoUFaqowSOTVUBRqL6Ko9dZ\nX/7a8uADVCj+jTkWRXX4nf5mxZmaFTSa7UiNwnUlUjtRp2MPcT23RzfZibHHDnW/\nJCZcKoApZh+4Pmi5HehPHnPbrSfFd9Kc+8o2P0YvgxW5Knrvts0lfNU8jTRJRHgQ\nCsLBu2pNdPZYKHB9yIonD+H0L1ChVkOug7VYTeTL/zSz2efP3YICc8kKnsK/hz2V\n719KQS2HXx4JzwIS7RX8t6CJB1Uxg2qkLpBpK2yort1hXRtJUqe630LNEoE8+ZpQ\nDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCdX999YTSokcZEm37bkE3QxMLyZf4J\nQfwvhor3fQxKki3XQbmGZ03wlWcnlDIpLxFcHIHb1JAPWRlPFeBU9Ai4v+4Wgq3o\nr8qEZXuZhbBCfUSbmetgrVOYttnnqDs/L3+RGCF5rXLJQ3G76MlDnOqgOcRUjF5g\n3KkmJiCxm5JicAm+wKT/cqx4Hy5DdSYDUfi10g8fclt/AZ8VAmzI3NL+jhWPRv6c\nMdT90N0igOLgng0tLvyKSnpOWNowny8uBD7hT6uVKM7rrMbSV55PHWPdY4VpIn5s\niIEklvJuyfvHMBGxnhx8GxfxDfZQpHiCh7Gj8DicKhReNjkVE8NZUmJg\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:42:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[17460]: audit 2024-01-21T07:42:49.897985+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDVRPLSXuFLxJRZFcAA8a1ZMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMTIxMDc0MjQ5WhcN\nMzQwMTE4MDc0MjQ5WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsqYjVXPlC303twwKXfnS\nB2vwT+Cs2qISFL6KY1P052hc9zyYVymWjvYoc0lYVzoUFaqowSOTVUBRqL6Ko9dZ\nX/7a8uADVCj+jTkWRXX4nf5mxZmaFTSa7UiNwnUlUjtRp2MPcT23RzfZibHHDnW/\nJCZcKoApZh+4Pmi5HehPHnPbrSfFd9Kc+8o2P0YvgxW5Knrvts0lfNU8jTRJRHgQ\nCsLBu2pNdPZYKHB9yIonD+H0L1ChVkOug7VYTeTL/zSz2efP3YICc8kKnsK/hz2V\n719KQS2HXx4JzwIS7RX8t6CJB1Uxg2qkLpBpK2yort1hXRtJUqe630LNEoE8+ZpQ\nDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCdX999YTSokcZEm37bkE3QxMLyZf4J\nQfwvhor3fQxKki3XQbmGZ03wlWcnlDIpLxFcHIHb1JAPWRlPFeBU9Ai4v+4Wgq3o\nr8qEZXuZhbBCfUSbmetgrVOYttnnqDs/L3+RGCF5rXLJQ3G76MlDnOqgOcRUjF5g\n3KkmJiCxm5JicAm+wKT/cqx4Hy5DdSYDUfi10g8fclt/AZ8VAmzI3NL+jhWPRv6c\nMdT90N0igOLgng0tLvyKSnpOWNowny8uBD7hT6uVKM7rrMbSV55PHWPdY4VpIn5s\niIEklvJuyfvHMBGxnhx8GxfxDfZQpHiCh7Gj8DicKhReNjkVE8NZUmJg\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:42:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[13909]: audit 2024-01-21T07:42:49.890981+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDVRPLSXuFLxJRZFcAA8a1ZMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMTIxMDc0MjQ5WhcN\nMzQwMTE4MDc0MjQ5WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsqYjVXPlC303twwKXfnS\nB2vwT+Cs2qISFL6KY1P052hc9zyYVymWjvYoc0lYVzoUFaqowSOTVUBRqL6Ko9dZ\nX/7a8uADVCj+jTkWRXX4nf5mxZmaFTSa7UiNwnUlUjtRp2MPcT23RzfZibHHDnW/\nJCZcKoApZh+4Pmi5HehPHnPbrSfFd9Kc+8o2P0YvgxW5Knrvts0lfNU8jTRJRHgQ\nCsLBu2pNdPZYKHB9yIonD+H0L1ChVkOug7VYTeTL/zSz2efP3YICc8kKnsK/hz2V\n719KQS2HXx4JzwIS7RX8t6CJB1Uxg2qkLpBpK2yort1hXRtJUqe630LNEoE8+ZpQ\nDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCdX999YTSokcZEm37bkE3QxMLyZf4J\nQfwvhor3fQxKki3XQbmGZ03wlWcnlDIpLxFcHIHb1JAPWRlPFeBU9Ai4v+4Wgq3o\nr8qEZXuZhbBCfUSbmetgrVOYttnnqDs/L3+RGCF5rXLJQ3G76MlDnOqgOcRUjF5g\n3KkmJiCxm5JicAm+wKT/cqx4Hy5DdSYDUfi10g8fclt/AZ8VAmzI3NL+jhWPRv6c\nMdT90N0igOLgng0tLvyKSnpOWNowny8uBD7hT6uVKM7rrMbSV55PHWPdY4VpIn5s\niIEklvJuyfvHMBGxnhx8GxfxDfZQpHiCh7Gj8DicKhReNjkVE8NZUmJg\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:42:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[13909]: audit 2024-01-21T07:42:49.897985+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDVRPLSXuFLxJRZFcAA8a1ZMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMTIxMDc0MjQ5WhcN\nMzQwMTE4MDc0MjQ5WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsqYjVXPlC303twwKXfnS\nB2vwT+Cs2qISFL6KY1P052hc9zyYVymWjvYoc0lYVzoUFaqowSOTVUBRqL6Ko9dZ\nX/7a8uADVCj+jTkWRXX4nf5mxZmaFTSa7UiNwnUlUjtRp2MPcT23RzfZibHHDnW/\nJCZcKoApZh+4Pmi5HehPHnPbrSfFd9Kc+8o2P0YvgxW5Knrvts0lfNU8jTRJRHgQ\nCsLBu2pNdPZYKHB9yIonD+H0L1ChVkOug7VYTeTL/zSz2efP3YICc8kKnsK/hz2V\n719KQS2HXx4JzwIS7RX8t6CJB1Uxg2qkLpBpK2yort1hXRtJUqe630LNEoE8+ZpQ\nDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCdX999YTSokcZEm37bkE3QxMLyZf4J\nQfwvhor3fQxKki3XQbmGZ03wlWcnlDIpLxFcHIHb1JAPWRlPFeBU9Ai4v+4Wgq3o\nr8qEZXuZhbBCfUSbmetgrVOYttnnqDs/L3+RGCF5rXLJQ3G76MlDnOqgOcRUjF5g\n3KkmJiCxm5JicAm+wKT/cqx4Hy5DdSYDUfi10g8fclt/AZ8VAmzI3NL+jhWPRv6c\nMdT90N0igOLgng0tLvyKSnpOWNowny8uBD7hT6uVKM7rrMbSV55PHWPdY4VpIn5s\niIEklvJuyfvHMBGxnhx8GxfxDfZQpHiCh7Gj8DicKhReNjkVE8NZUmJg\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:42:51.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[17460]: audit 2024-01-21T07:42:49.898841+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCypiNVc+ULfTe3\nDApd+dIHa/BP4KzaohIUvopjU/TnaFz3PJhXKZaO9ihzSVhXOhQVqqjBI5NVQFGo\nvoqj11lf/try4ANUKP6NORZFdfid/mbFmZoVNJrtSI3CdSVSO1GnYw9xPbdHN9mJ\nsccOdb8kJlwqgClmH7g+aLkd6E8ec9utJ8V30pz7yjY/Ri+DFbkqeu+2zSV81TyN\nNElEeBAKwsG7ak109lgocH3IiicP4fQvUKFWQ66DtVhN5Mv/NLPZ58/dggJzyQqe\nwr+HPZXvX0pBLYdfHgnPAhLtFfy3oIkHVTGDaqQukGkrbKiu3WFdG0lSp7rfQs0S\ngTz5mlAPAgMBAAECggEAXs1fTseTsocee9q93aTm2d1jx1+5GsSKx8tdcNxqyCpP\nuzvCs+5z4SWrzZIMeS1u3xiTOPsCAmmBbATBWbS7zv9VfTF3Ur/2ZUb4FKBH8L/C\nFfYvGDW0SVsJLzovNfYYnLUqyrMvgXGX1UQsF/ZQGoTov/0G+xS2FxhHtCFFayi5\nXHpw19xzRCSkRD2wP0cQyHniwiTNZYukPxLkpHDLQNkKxzcFjpP+eNgq+HkJycU6\nceFV6qJai/tzyJfUEATwQnylO3JDE2oRbNteMUF8LnRG3TuBCqgk3TQvrO75BFTN\nEF/3uQyGq8lu+nMBEUaxOFjldL7QqvxY5AGXZJpssQKBgQDYCZSlFAwrXuJ8ekHu\nbpzmQxNemEa6xenQyTBisdBc3ekBw7clJpSmLMuRL3hUXv+2WBC0Z6xYtP0rxiK8\n/nrGg2Zea8WhL/gEPTuisWJWWSNKLLb4Qpix+Vpc5hgC2fUbN3KXoHNclW1feCRK\nbG6wY30OFnkVQV/XM1YaVann6wKBgQDTsgh67XIBTzubuvY8PnqPgpz4EdLA6LOc\nkE2o5I60S/S1YW8x+0AEttRBs2g5ZmmjRFOFnRLfg59tlhXZ4xzx5CdRQux8yFmM\n1Gl7/lRXL8QnZ+eIg8lgc6Szh/OcteRsDS4FXTNRXwsUY6qgRUpLhLmWEnkSGrEZ\nHQ5X9jxzbQKBgE7Kf7oNK7sNqhC4Dh/Fm9enEwNnCjTIRdRt7AWy0ElubbLFDKCy\nB3jr0XqsE3jCBQUd7Um+ne7kY4l5g+Xl8iVAey9oovV8pzn0kzFs/G59qA8/a6Pz\ntfkC9l/3Uz6G+4vnlxWR4UEdBnzRNnsmPOB8CHoA3DxSUYANKxQDtintAoGBAKSy\nTsysbNS9+ucWlrmZ9ioueMa6vxecMxisX+71Gl0E9vYiPqtJCK5iO1J+LKjzl14R\nK1W5NVS1h1RvvsJMYlmComAjS+9sw9a/7u0rmhxWqinqOYTI2uPyNIIEVDBohrTV\nsCc2MlWtNuZ+/+E+5yVHtkceShkesQeTxnQCu1clAoGBAMLYEunrhqQx7M6b7962\npdIHYryzgY5aNyaGq62uZrrgLtcMkKTvRYLMv4aO5kGxksosD19OcwKd3DFMgT+s\nY3+X+yk8BMs0CGtAggTtzWUNVfgo+D12q5RN+jyy+QZG2GTlQVroLvRao1Jdffp0\nOSnEekWodDxRtp99lBfB7McT\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:42:51.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[17460]: audit 2024-01-21T07:42:49.902423+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCypiNVc+ULfTe3\nDApd+dIHa/BP4KzaohIUvopjU/TnaFz3PJhXKZaO9ihzSVhXOhQVqqjBI5NVQFGo\nvoqj11lf/try4ANUKP6NORZFdfid/mbFmZoVNJrtSI3CdSVSO1GnYw9xPbdHN9mJ\nsccOdb8kJlwqgClmH7g+aLkd6E8ec9utJ8V30pz7yjY/Ri+DFbkqeu+2zSV81TyN\nNElEeBAKwsG7ak109lgocH3IiicP4fQvUKFWQ66DtVhN5Mv/NLPZ58/dggJzyQqe\nwr+HPZXvX0pBLYdfHgnPAhLtFfy3oIkHVTGDaqQukGkrbKiu3WFdG0lSp7rfQs0S\ngTz5mlAPAgMBAAECggEAXs1fTseTsocee9q93aTm2d1jx1+5GsSKx8tdcNxqyCpP\nuzvCs+5z4SWrzZIMeS1u3xiTOPsCAmmBbATBWbS7zv9VfTF3Ur/2ZUb4FKBH8L/C\nFfYvGDW0SVsJLzovNfYYnLUqyrMvgXGX1UQsF/ZQGoTov/0G+xS2FxhHtCFFayi5\nXHpw19xzRCSkRD2wP0cQyHniwiTNZYukPxLkpHDLQNkKxzcFjpP+eNgq+HkJycU6\nceFV6qJai/tzyJfUEATwQnylO3JDE2oRbNteMUF8LnRG3TuBCqgk3TQvrO75BFTN\nEF/3uQyGq8lu+nMBEUaxOFjldL7QqvxY5AGXZJpssQKBgQDYCZSlFAwrXuJ8ekHu\nbpzmQxNemEa6xenQyTBisdBc3ekBw7clJpSmLMuRL3hUXv+2WBC0Z6xYtP0rxiK8\n/nrGg2Zea8WhL/gEPTuisWJWWSNKLLb4Qpix+Vpc5hgC2fUbN3KXoHNclW1feCRK\nbG6wY30OFnkVQV/XM1YaVann6wKBgQDTsgh67XIBTzubuvY8PnqPgpz4EdLA6LOc\nkE2o5I60S/S1YW8x+0AEttRBs2g5ZmmjRFOFnRLfg59tlhXZ4xzx5CdRQux8yFmM\n1Gl7/lRXL8QnZ+eIg8lgc6Szh/OcteRsDS4FXTNRXwsUY6qgRUpLhLmWEnkSGrEZ\nHQ5X9jxzbQKBgE7Kf7oNK7sNqhC4Dh/Fm9enEwNnCjTIRdRt7AWy0ElubbLFDKCy\nB3jr0XqsE3jCBQUd7Um+ne7kY4l5g+Xl8iVAey9oovV8pzn0kzFs/G59qA8/a6Pz\ntfkC9l/3Uz6G+4vnlxWR4UEdBnzRNnsmPOB8CHoA3DxSUYANKxQDtintAoGBAKSy\nTsysbNS9+ucWlrmZ9ioueMa6vxecMxisX+71Gl0E9vYiPqtJCK5iO1J+LKjzl14R\nK1W5NVS1h1RvvsJMYlmComAjS+9sw9a/7u0rmhxWqinqOYTI2uPyNIIEVDBohrTV\nsCc2MlWtNuZ+/+E+5yVHtkceShkesQeTxnQCu1clAoGBAMLYEunrhqQx7M6b7962\npdIHYryzgY5aNyaGq62uZrrgLtcMkKTvRYLMv4aO5kGxksosD19OcwKd3DFMgT+s\nY3+X+yk8BMs0CGtAggTtzWUNVfgo+D12q5RN+jyy+QZG2GTlQVroLvRao1Jdffp0\nOSnEekWodDxRtp99lBfB7McT\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:42:51.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[17460]: cephadm 2024-01-21T07:42:49.903204+0000 mgr.y (mgr.14140) 223 : cephadm [INF] Deploying daemon grafana.a on smithi195 2024-01-21T07:42:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[13909]: audit 2024-01-21T07:42:49.898841+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCypiNVc+ULfTe3\nDApd+dIHa/BP4KzaohIUvopjU/TnaFz3PJhXKZaO9ihzSVhXOhQVqqjBI5NVQFGo\nvoqj11lf/try4ANUKP6NORZFdfid/mbFmZoVNJrtSI3CdSVSO1GnYw9xPbdHN9mJ\nsccOdb8kJlwqgClmH7g+aLkd6E8ec9utJ8V30pz7yjY/Ri+DFbkqeu+2zSV81TyN\nNElEeBAKwsG7ak109lgocH3IiicP4fQvUKFWQ66DtVhN5Mv/NLPZ58/dggJzyQqe\nwr+HPZXvX0pBLYdfHgnPAhLtFfy3oIkHVTGDaqQukGkrbKiu3WFdG0lSp7rfQs0S\ngTz5mlAPAgMBAAECggEAXs1fTseTsocee9q93aTm2d1jx1+5GsSKx8tdcNxqyCpP\nuzvCs+5z4SWrzZIMeS1u3xiTOPsCAmmBbATBWbS7zv9VfTF3Ur/2ZUb4FKBH8L/C\nFfYvGDW0SVsJLzovNfYYnLUqyrMvgXGX1UQsF/ZQGoTov/0G+xS2FxhHtCFFayi5\nXHpw19xzRCSkRD2wP0cQyHniwiTNZYukPxLkpHDLQNkKxzcFjpP+eNgq+HkJycU6\nceFV6qJai/tzyJfUEATwQnylO3JDE2oRbNteMUF8LnRG3TuBCqgk3TQvrO75BFTN\nEF/3uQyGq8lu+nMBEUaxOFjldL7QqvxY5AGXZJpssQKBgQDYCZSlFAwrXuJ8ekHu\nbpzmQxNemEa6xenQyTBisdBc3ekBw7clJpSmLMuRL3hUXv+2WBC0Z6xYtP0rxiK8\n/nrGg2Zea8WhL/gEPTuisWJWWSNKLLb4Qpix+Vpc5hgC2fUbN3KXoHNclW1feCRK\nbG6wY30OFnkVQV/XM1YaVann6wKBgQDTsgh67XIBTzubuvY8PnqPgpz4EdLA6LOc\nkE2o5I60S/S1YW8x+0AEttRBs2g5ZmmjRFOFnRLfg59tlhXZ4xzx5CdRQux8yFmM\n1Gl7/lRXL8QnZ+eIg8lgc6Szh/OcteRsDS4FXTNRXwsUY6qgRUpLhLmWEnkSGrEZ\nHQ5X9jxzbQKBgE7Kf7oNK7sNqhC4Dh/Fm9enEwNnCjTIRdRt7AWy0ElubbLFDKCy\nB3jr0XqsE3jCBQUd7Um+ne7kY4l5g+Xl8iVAey9oovV8pzn0kzFs/G59qA8/a6Pz\ntfkC9l/3Uz6G+4vnlxWR4UEdBnzRNnsmPOB8CHoA3DxSUYANKxQDtintAoGBAKSy\nTsysbNS9+ucWlrmZ9ioueMa6vxecMxisX+71Gl0E9vYiPqtJCK5iO1J+LKjzl14R\nK1W5NVS1h1RvvsJMYlmComAjS+9sw9a/7u0rmhxWqinqOYTI2uPyNIIEVDBohrTV\nsCc2MlWtNuZ+/+E+5yVHtkceShkesQeTxnQCu1clAoGBAMLYEunrhqQx7M6b7962\npdIHYryzgY5aNyaGq62uZrrgLtcMkKTvRYLMv4aO5kGxksosD19OcwKd3DFMgT+s\nY3+X+yk8BMs0CGtAggTtzWUNVfgo+D12q5RN+jyy+QZG2GTlQVroLvRao1Jdffp0\nOSnEekWodDxRtp99lBfB7McT\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:42:51.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[13909]: audit 2024-01-21T07:42:49.902423+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCypiNVc+ULfTe3\nDApd+dIHa/BP4KzaohIUvopjU/TnaFz3PJhXKZaO9ihzSVhXOhQVqqjBI5NVQFGo\nvoqj11lf/try4ANUKP6NORZFdfid/mbFmZoVNJrtSI3CdSVSO1GnYw9xPbdHN9mJ\nsccOdb8kJlwqgClmH7g+aLkd6E8ec9utJ8V30pz7yjY/Ri+DFbkqeu+2zSV81TyN\nNElEeBAKwsG7ak109lgocH3IiicP4fQvUKFWQ66DtVhN5Mv/NLPZ58/dggJzyQqe\nwr+HPZXvX0pBLYdfHgnPAhLtFfy3oIkHVTGDaqQukGkrbKiu3WFdG0lSp7rfQs0S\ngTz5mlAPAgMBAAECggEAXs1fTseTsocee9q93aTm2d1jx1+5GsSKx8tdcNxqyCpP\nuzvCs+5z4SWrzZIMeS1u3xiTOPsCAmmBbATBWbS7zv9VfTF3Ur/2ZUb4FKBH8L/C\nFfYvGDW0SVsJLzovNfYYnLUqyrMvgXGX1UQsF/ZQGoTov/0G+xS2FxhHtCFFayi5\nXHpw19xzRCSkRD2wP0cQyHniwiTNZYukPxLkpHDLQNkKxzcFjpP+eNgq+HkJycU6\nceFV6qJai/tzyJfUEATwQnylO3JDE2oRbNteMUF8LnRG3TuBCqgk3TQvrO75BFTN\nEF/3uQyGq8lu+nMBEUaxOFjldL7QqvxY5AGXZJpssQKBgQDYCZSlFAwrXuJ8ekHu\nbpzmQxNemEa6xenQyTBisdBc3ekBw7clJpSmLMuRL3hUXv+2WBC0Z6xYtP0rxiK8\n/nrGg2Zea8WhL/gEPTuisWJWWSNKLLb4Qpix+Vpc5hgC2fUbN3KXoHNclW1feCRK\nbG6wY30OFnkVQV/XM1YaVann6wKBgQDTsgh67XIBTzubuvY8PnqPgpz4EdLA6LOc\nkE2o5I60S/S1YW8x+0AEttRBs2g5ZmmjRFOFnRLfg59tlhXZ4xzx5CdRQux8yFmM\n1Gl7/lRXL8QnZ+eIg8lgc6Szh/OcteRsDS4FXTNRXwsUY6qgRUpLhLmWEnkSGrEZ\nHQ5X9jxzbQKBgE7Kf7oNK7sNqhC4Dh/Fm9enEwNnCjTIRdRt7AWy0ElubbLFDKCy\nB3jr0XqsE3jCBQUd7Um+ne7kY4l5g+Xl8iVAey9oovV8pzn0kzFs/G59qA8/a6Pz\ntfkC9l/3Uz6G+4vnlxWR4UEdBnzRNnsmPOB8CHoA3DxSUYANKxQDtintAoGBAKSy\nTsysbNS9+ucWlrmZ9ioueMa6vxecMxisX+71Gl0E9vYiPqtJCK5iO1J+LKjzl14R\nK1W5NVS1h1RvvsJMYlmComAjS+9sw9a/7u0rmhxWqinqOYTI2uPyNIIEVDBohrTV\nsCc2MlWtNuZ+/+E+5yVHtkceShkesQeTxnQCu1clAoGBAMLYEunrhqQx7M6b7962\npdIHYryzgY5aNyaGq62uZrrgLtcMkKTvRYLMv4aO5kGxksosD19OcwKd3DFMgT+s\nY3+X+yk8BMs0CGtAggTtzWUNVfgo+D12q5RN+jyy+QZG2GTlQVroLvRao1Jdffp0\nOSnEekWodDxRtp99lBfB7McT\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:42:51.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:50 smithi080 bash[13909]: cephadm 2024-01-21T07:42:49.903204+0000 mgr.y (mgr.14140) 223 : cephadm [INF] Deploying daemon grafana.a on smithi195 2024-01-21T07:42:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:50 smithi195 bash[13978]: audit 2024-01-21T07:42:49.890981+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDVRPLSXuFLxJRZFcAA8a1ZMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMTIxMDc0MjQ5WhcN\nMzQwMTE4MDc0MjQ5WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsqYjVXPlC303twwKXfnS\nB2vwT+Cs2qISFL6KY1P052hc9zyYVymWjvYoc0lYVzoUFaqowSOTVUBRqL6Ko9dZ\nX/7a8uADVCj+jTkWRXX4nf5mxZmaFTSa7UiNwnUlUjtRp2MPcT23RzfZibHHDnW/\nJCZcKoApZh+4Pmi5HehPHnPbrSfFd9Kc+8o2P0YvgxW5Knrvts0lfNU8jTRJRHgQ\nCsLBu2pNdPZYKHB9yIonD+H0L1ChVkOug7VYTeTL/zSz2efP3YICc8kKnsK/hz2V\n719KQS2HXx4JzwIS7RX8t6CJB1Uxg2qkLpBpK2yort1hXRtJUqe630LNEoE8+ZpQ\nDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCdX999YTSokcZEm37bkE3QxMLyZf4J\nQfwvhor3fQxKki3XQbmGZ03wlWcnlDIpLxFcHIHb1JAPWRlPFeBU9Ai4v+4Wgq3o\nr8qEZXuZhbBCfUSbmetgrVOYttnnqDs/L3+RGCF5rXLJQ3G76MlDnOqgOcRUjF5g\n3KkmJiCxm5JicAm+wKT/cqx4Hy5DdSYDUfi10g8fclt/AZ8VAmzI3NL+jhWPRv6c\nMdT90N0igOLgng0tLvyKSnpOWNowny8uBD7hT6uVKM7rrMbSV55PHWPdY4VpIn5s\niIEklvJuyfvHMBGxnhx8GxfxDfZQpHiCh7Gj8DicKhReNjkVE8NZUmJg\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:42:51.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:50 smithi195 bash[13978]: audit 2024-01-21T07:42:49.897985+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDVRPLSXuFLxJRZFcAA8a1ZMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMTIxMDc0MjQ5WhcN\nMzQwMTE4MDc0MjQ5WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAsqYjVXPlC303twwKXfnS\nB2vwT+Cs2qISFL6KY1P052hc9zyYVymWjvYoc0lYVzoUFaqowSOTVUBRqL6Ko9dZ\nX/7a8uADVCj+jTkWRXX4nf5mxZmaFTSa7UiNwnUlUjtRp2MPcT23RzfZibHHDnW/\nJCZcKoApZh+4Pmi5HehPHnPbrSfFd9Kc+8o2P0YvgxW5Knrvts0lfNU8jTRJRHgQ\nCsLBu2pNdPZYKHB9yIonD+H0L1ChVkOug7VYTeTL/zSz2efP3YICc8kKnsK/hz2V\n719KQS2HXx4JzwIS7RX8t6CJB1Uxg2qkLpBpK2yort1hXRtJUqe630LNEoE8+ZpQ\nDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCdX999YTSokcZEm37bkE3QxMLyZf4J\nQfwvhor3fQxKki3XQbmGZ03wlWcnlDIpLxFcHIHb1JAPWRlPFeBU9Ai4v+4Wgq3o\nr8qEZXuZhbBCfUSbmetgrVOYttnnqDs/L3+RGCF5rXLJQ3G76MlDnOqgOcRUjF5g\n3KkmJiCxm5JicAm+wKT/cqx4Hy5DdSYDUfi10g8fclt/AZ8VAmzI3NL+jhWPRv6c\nMdT90N0igOLgng0tLvyKSnpOWNowny8uBD7hT6uVKM7rrMbSV55PHWPdY4VpIn5s\niIEklvJuyfvHMBGxnhx8GxfxDfZQpHiCh7Gj8DicKhReNjkVE8NZUmJg\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:42:51.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:50 smithi195 bash[13978]: audit 2024-01-21T07:42:49.898841+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCypiNVc+ULfTe3\nDApd+dIHa/BP4KzaohIUvopjU/TnaFz3PJhXKZaO9ihzSVhXOhQVqqjBI5NVQFGo\nvoqj11lf/try4ANUKP6NORZFdfid/mbFmZoVNJrtSI3CdSVSO1GnYw9xPbdHN9mJ\nsccOdb8kJlwqgClmH7g+aLkd6E8ec9utJ8V30pz7yjY/Ri+DFbkqeu+2zSV81TyN\nNElEeBAKwsG7ak109lgocH3IiicP4fQvUKFWQ66DtVhN5Mv/NLPZ58/dggJzyQqe\nwr+HPZXvX0pBLYdfHgnPAhLtFfy3oIkHVTGDaqQukGkrbKiu3WFdG0lSp7rfQs0S\ngTz5mlAPAgMBAAECggEAXs1fTseTsocee9q93aTm2d1jx1+5GsSKx8tdcNxqyCpP\nuzvCs+5z4SWrzZIMeS1u3xiTOPsCAmmBbATBWbS7zv9VfTF3Ur/2ZUb4FKBH8L/C\nFfYvGDW0SVsJLzovNfYYnLUqyrMvgXGX1UQsF/ZQGoTov/0G+xS2FxhHtCFFayi5\nXHpw19xzRCSkRD2wP0cQyHniwiTNZYukPxLkpHDLQNkKxzcFjpP+eNgq+HkJycU6\nceFV6qJai/tzyJfUEATwQnylO3JDE2oRbNteMUF8LnRG3TuBCqgk3TQvrO75BFTN\nEF/3uQyGq8lu+nMBEUaxOFjldL7QqvxY5AGXZJpssQKBgQDYCZSlFAwrXuJ8ekHu\nbpzmQxNemEa6xenQyTBisdBc3ekBw7clJpSmLMuRL3hUXv+2WBC0Z6xYtP0rxiK8\n/nrGg2Zea8WhL/gEPTuisWJWWSNKLLb4Qpix+Vpc5hgC2fUbN3KXoHNclW1feCRK\nbG6wY30OFnkVQV/XM1YaVann6wKBgQDTsgh67XIBTzubuvY8PnqPgpz4EdLA6LOc\nkE2o5I60S/S1YW8x+0AEttRBs2g5ZmmjRFOFnRLfg59tlhXZ4xzx5CdRQux8yFmM\n1Gl7/lRXL8QnZ+eIg8lgc6Szh/OcteRsDS4FXTNRXwsUY6qgRUpLhLmWEnkSGrEZ\nHQ5X9jxzbQKBgE7Kf7oNK7sNqhC4Dh/Fm9enEwNnCjTIRdRt7AWy0ElubbLFDKCy\nB3jr0XqsE3jCBQUd7Um+ne7kY4l5g+Xl8iVAey9oovV8pzn0kzFs/G59qA8/a6Pz\ntfkC9l/3Uz6G+4vnlxWR4UEdBnzRNnsmPOB8CHoA3DxSUYANKxQDtintAoGBAKSy\nTsysbNS9+ucWlrmZ9ioueMa6vxecMxisX+71Gl0E9vYiPqtJCK5iO1J+LKjzl14R\nK1W5NVS1h1RvvsJMYlmComAjS+9sw9a/7u0rmhxWqinqOYTI2uPyNIIEVDBohrTV\nsCc2MlWtNuZ+/+E+5yVHtkceShkesQeTxnQCu1clAoGBAMLYEunrhqQx7M6b7962\npdIHYryzgY5aNyaGq62uZrrgLtcMkKTvRYLMv4aO5kGxksosD19OcwKd3DFMgT+s\nY3+X+yk8BMs0CGtAggTtzWUNVfgo+D12q5RN+jyy+QZG2GTlQVroLvRao1Jdffp0\nOSnEekWodDxRtp99lBfB7McT\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:42:51.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:50 smithi195 bash[13978]: audit 2024-01-21T07:42:49.902423+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCypiNVc+ULfTe3\nDApd+dIHa/BP4KzaohIUvopjU/TnaFz3PJhXKZaO9ihzSVhXOhQVqqjBI5NVQFGo\nvoqj11lf/try4ANUKP6NORZFdfid/mbFmZoVNJrtSI3CdSVSO1GnYw9xPbdHN9mJ\nsccOdb8kJlwqgClmH7g+aLkd6E8ec9utJ8V30pz7yjY/Ri+DFbkqeu+2zSV81TyN\nNElEeBAKwsG7ak109lgocH3IiicP4fQvUKFWQ66DtVhN5Mv/NLPZ58/dggJzyQqe\nwr+HPZXvX0pBLYdfHgnPAhLtFfy3oIkHVTGDaqQukGkrbKiu3WFdG0lSp7rfQs0S\ngTz5mlAPAgMBAAECggEAXs1fTseTsocee9q93aTm2d1jx1+5GsSKx8tdcNxqyCpP\nuzvCs+5z4SWrzZIMeS1u3xiTOPsCAmmBbATBWbS7zv9VfTF3Ur/2ZUb4FKBH8L/C\nFfYvGDW0SVsJLzovNfYYnLUqyrMvgXGX1UQsF/ZQGoTov/0G+xS2FxhHtCFFayi5\nXHpw19xzRCSkRD2wP0cQyHniwiTNZYukPxLkpHDLQNkKxzcFjpP+eNgq+HkJycU6\nceFV6qJai/tzyJfUEATwQnylO3JDE2oRbNteMUF8LnRG3TuBCqgk3TQvrO75BFTN\nEF/3uQyGq8lu+nMBEUaxOFjldL7QqvxY5AGXZJpssQKBgQDYCZSlFAwrXuJ8ekHu\nbpzmQxNemEa6xenQyTBisdBc3ekBw7clJpSmLMuRL3hUXv+2WBC0Z6xYtP0rxiK8\n/nrGg2Zea8WhL/gEPTuisWJWWSNKLLb4Qpix+Vpc5hgC2fUbN3KXoHNclW1feCRK\nbG6wY30OFnkVQV/XM1YaVann6wKBgQDTsgh67XIBTzubuvY8PnqPgpz4EdLA6LOc\nkE2o5I60S/S1YW8x+0AEttRBs2g5ZmmjRFOFnRLfg59tlhXZ4xzx5CdRQux8yFmM\n1Gl7/lRXL8QnZ+eIg8lgc6Szh/OcteRsDS4FXTNRXwsUY6qgRUpLhLmWEnkSGrEZ\nHQ5X9jxzbQKBgE7Kf7oNK7sNqhC4Dh/Fm9enEwNnCjTIRdRt7AWy0ElubbLFDKCy\nB3jr0XqsE3jCBQUd7Um+ne7kY4l5g+Xl8iVAey9oovV8pzn0kzFs/G59qA8/a6Pz\ntfkC9l/3Uz6G+4vnlxWR4UEdBnzRNnsmPOB8CHoA3DxSUYANKxQDtintAoGBAKSy\nTsysbNS9+ucWlrmZ9ioueMa6vxecMxisX+71Gl0E9vYiPqtJCK5iO1J+LKjzl14R\nK1W5NVS1h1RvvsJMYlmComAjS+9sw9a/7u0rmhxWqinqOYTI2uPyNIIEVDBohrTV\nsCc2MlWtNuZ+/+E+5yVHtkceShkesQeTxnQCu1clAoGBAMLYEunrhqQx7M6b7962\npdIHYryzgY5aNyaGq62uZrrgLtcMkKTvRYLMv4aO5kGxksosD19OcwKd3DFMgT+s\nY3+X+yk8BMs0CGtAggTtzWUNVfgo+D12q5RN+jyy+QZG2GTlQVroLvRao1Jdffp0\nOSnEekWodDxRtp99lBfB7McT\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:42:51.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:50 smithi195 bash[13978]: cephadm 2024-01-21T07:42:49.903204+0000 mgr.y (mgr.14140) 223 : cephadm [INF] Deploying daemon grafana.a on smithi195 2024-01-21T07:42:51.756 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-21T07:42:51.756 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-01-21T07:42:51.756 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph mgr dump --format=json 2024-01-21T07:42:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:51 smithi080 bash[13909]: audit 2024-01-21T07:42:51.022847+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.80:0/1368000344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-01-21T07:42:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:51 smithi080 bash[13909]: cluster 2024-01-21T07:42:51.751033+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:52.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:51 smithi080 bash[17460]: audit 2024-01-21T07:42:51.022847+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.80:0/1368000344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-01-21T07:42:52.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:51 smithi080 bash[17460]: cluster 2024-01-21T07:42:51.751033+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:52.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:51 smithi195 bash[13978]: audit 2024-01-21T07:42:51.022847+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.80:0/1368000344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-01-21T07:42:52.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:51 smithi195 bash[13978]: cluster 2024-01-21T07:42:51.751033+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:54.355 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:42:54.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:54 smithi080 bash[13909]: cluster 2024-01-21T07:42:53.751674+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:54.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:54 smithi080 bash[13909]: audit 2024-01-21T07:42:54.346763+0000 mon.a (mon.0) 492 : audit [DBG] from='client.? 172.21.15.80:0/3100774273' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-21T07:42:54.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:54 smithi080 bash[17460]: cluster 2024-01-21T07:42:53.751674+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:54.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:54 smithi080 bash[17460]: audit 2024-01-21T07:42:54.346763+0000 mon.a (mon.0) 492 : audit [DBG] from='client.? 172.21.15.80:0/3100774273' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-21T07:42:55.000 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4055125463},{"type":"v1","addr":"172.21.15.80:6801","nonce":4055125463}]},"active_addr":"172.21.15.80:6801/4055125463","active_change":"2024-01-21T07:37:18.988808+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi080.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2157608289}]},{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":182809179}]},{"addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3246649684}]}]}} 2024-01-21T07:42:55.003 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-01-21T07:42:55.003 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-01-21T07:42:55.003 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd dump --format=json 2024-01-21T07:42:55.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:54 smithi195 bash[13978]: cluster 2024-01-21T07:42:53.751674+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:55.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:54 smithi195 bash[13978]: audit 2024-01-21T07:42:54.346763+0000 mon.a (mon.0) 492 : audit [DBG] from='client.? 172.21.15.80:0/3100774273' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-21T07:42:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:55 smithi195 bash[13978]: cluster 2024-01-21T07:42:55.752181+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:56.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:55 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 2. 2024-01-21T07:42:56.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:55 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:56.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:55 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:42:56.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:55 smithi195 docker[22449]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:42:56.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:55 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:42:56.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:55 smithi195 bash[22466]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:42:56.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:55 smithi080 bash[13909]: cluster 2024-01-21T07:42:55.752181+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:56.185 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:55 smithi080 bash[17460]: cluster 2024-01-21T07:42:55.752181+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:57.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:56 smithi195 bash[22466]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:42:57.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:56 smithi195 bash[22466]: See 'docker run --help'. 2024-01-21T07:42:57.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:56 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:42:57.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:42:56 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:42:57.649 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:42:57.649 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":49,"fsid":"b86415d2-b82f-11ee-95b0-87774f69a715","created":"2024-01-21T07:36:42.230921+0000","modified":"2024-01-21T07:42:17.759082+0000","last_up_change":"2024-01-21T07:42:16.744711+0000","last_in_change":"2024-01-21T07:42:16.744711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T07:36:55.297510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9ef0e6e3-19f4-49c4-9074-c94be9e385bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6803","nonce":440522277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6805","nonce":440522277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6809","nonce":440522277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6807","nonce":440522277}]},"public_addr":"172.21.15.80:6803/440522277","cluster_addr":"172.21.15.80:6805/440522277","heartbeat_back_addr":"172.21.15.80:6809/440522277","heartbeat_front_addr":"172.21.15.80:6807/440522277","state":["exists","up"]},{"osd":1,"uuid":"e40c68c3-96c6-45e5-875a-cd0b65d215ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6811","nonce":4131031317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6813","nonce":4131031317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6817","nonce":4131031317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6815","nonce":4131031317}]},"public_addr":"172.21.15.80:6811/4131031317","cluster_addr":"172.21.15.80:6813/4131031317","heartbeat_back_addr":"172.21.15.80:6817/4131031317","heartbeat_front_addr":"172.21.15.80:6815/4131031317","state":["exists","up"]},{"osd":2,"uuid":"8761092d-c3ee-4a24-9d86-39182ffb54e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6819","nonce":1036175868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6821","nonce":1036175868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6825","nonce":1036175868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6823","nonce":1036175868}]},"public_addr":"172.21.15.80:6819/1036175868","cluster_addr":"172.21.15.80:6821/1036175868","heartbeat_back_addr":"172.21.15.80:6825/1036175868","heartbeat_front_addr":"172.21.15.80:6823/1036175868","state":["exists","up"]},{"osd":3,"uuid":"1daf8576-7e1e-44cc-8477-c8108442dd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6827","nonce":1868846440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6829","nonce":1868846440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6833","nonce":1868846440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6831","nonce":1868846440}]},"public_addr":"172.21.15.80:6827/1868846440","cluster_addr":"172.21.15.80:6829/1868846440","heartbeat_back_addr":"172.21.15.80:6833/1868846440","heartbeat_front_addr":"172.21.15.80:6831/1868846440","state":["exists","up"]},{"osd":4,"uuid":"a2c86a3c-7c72-4f55-bf73-9ec14d925b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6801","nonce":2703158768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6803","nonce":2703158768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6807","nonce":2703158768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6805","nonce":2703158768}]},"public_addr":"172.21.15.195:6801/2703158768","cluster_addr":"172.21.15.195:6803/2703158768","heartbeat_back_addr":"172.21.15.195:6807/2703158768","heartbeat_front_addr":"172.21.15.195:6805/2703158768","state":["exists","up"]},{"osd":5,"uuid":"20fb8ae4-0923-4d21-936c-8c8ebbc279f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6809","nonce":1748131419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6811","nonce":1748131419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6815","nonce":1748131419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6813","nonce":1748131419}]},"public_addr":"172.21.15.195:6809/1748131419","cluster_addr":"172.21.15.195:6811/1748131419","heartbeat_back_addr":"172.21.15.195:6815/1748131419","heartbeat_front_addr":"172.21.15.195:6813/1748131419","state":["exists","up"]},{"osd":6,"uuid":"3e78aad1-ff7d-47d1-aabf-a437f0a10df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6817","nonce":129712859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6819","nonce":129712859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6823","nonce":129712859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6821","nonce":129712859}]},"public_addr":"172.21.15.195:6817/129712859","cluster_addr":"172.21.15.195:6819/129712859","heartbeat_back_addr":"172.21.15.195:6823/129712859","heartbeat_front_addr":"172.21.15.195:6821/129712859","state":["exists","up"]},{"osd":7,"uuid":"77f80413-d084-4cd8-a2d3-37352ceb17a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6825","nonce":768760592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6827","nonce":768760592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6831","nonce":768760592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6829","nonce":768760592}]},"public_addr":"172.21.15.195:6825/768760592","cluster_addr":"172.21.15.195:6827/768760592","heartbeat_back_addr":"172.21.15.195:6831/768760592","heartbeat_front_addr":"172.21.15.195:6829/768760592","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:39:17.380267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:39:43.857337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:09.754817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:35.260189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:56.755201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:41:23.441276+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:41:50.009201+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:42:14.757799+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.80:6800/1935270641":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/2682865589":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/876829809":"2024-01-22T07:37:18.988155+0000","172.21.15.80:6800/941119075":"2024-01-22T07:37:02.648111+0000","172.21.15.80:6801/1935270641":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/3112152988":"2024-01-22T07:37:02.648111+0000","172.21.15.80:0/927839510":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/1525539124":"2024-01-22T07:37:02.648111+0000","172.21.15.80:6801/941119075":"2024-01-22T07:37:02.648111+0000","172.21.15.80:0/2682426603":"2024-01-22T07:37:02.648111+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-01-21T07:42:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:57 smithi080 bash[13909]: audit 2024-01-21T07:42:57.646217+0000 mon.a (mon.0) 493 : audit [DBG] from='client.? 172.21.15.80:0/291238789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:42:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:57 smithi080 bash[17460]: audit 2024-01-21T07:42:57.646217+0000 mon.a (mon.0) 493 : audit [DBG] from='client.? 172.21.15.80:0/291238789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:42:58.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:57 smithi195 bash[13978]: audit 2024-01-21T07:42:57.646217+0000 mon.a (mon.0) 493 : audit [DBG] from='client.? 172.21.15.80:0/291238789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:42:58.332 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-01-21T07:42:58.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd dump --format=json 2024-01-21T07:42:58.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:58 smithi080 bash[13909]: cluster 2024-01-21T07:42:57.752761+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:58.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:58 smithi080 bash[17460]: cluster 2024-01-21T07:42:57.752761+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:42:59.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:58 smithi195 bash[13978]: cluster 2024-01-21T07:42:57.752761+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:42:59 smithi195 bash[13978]: cluster 2024-01-21T07:42:59.753329+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:00.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:42:59 smithi080 bash[13909]: cluster 2024-01-21T07:42:59.753329+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:00.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:42:59 smithi080 bash[17460]: cluster 2024-01-21T07:42:59.753329+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:00.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:59 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Scheduled restart job, restart counter is at 2. 2024-01-21T07:43:00.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:59 smithi080 systemd[1]: Stopped Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:00.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:59 smithi080 systemd[1]: Starting Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:00.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:59 smithi080 docker[26460]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.a 2024-01-21T07:43:00.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:59 smithi080 systemd[1]: Started Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:00.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:42:59 smithi080 bash[26471]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:01.115 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:43:01.116 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":49,"fsid":"b86415d2-b82f-11ee-95b0-87774f69a715","created":"2024-01-21T07:36:42.230921+0000","modified":"2024-01-21T07:42:17.759082+0000","last_up_change":"2024-01-21T07:42:16.744711+0000","last_in_change":"2024-01-21T07:42:16.744711+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T07:36:55.297510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9ef0e6e3-19f4-49c4-9074-c94be9e385bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6803","nonce":440522277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6805","nonce":440522277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6809","nonce":440522277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":440522277},{"type":"v1","addr":"172.21.15.80:6807","nonce":440522277}]},"public_addr":"172.21.15.80:6803/440522277","cluster_addr":"172.21.15.80:6805/440522277","heartbeat_back_addr":"172.21.15.80:6809/440522277","heartbeat_front_addr":"172.21.15.80:6807/440522277","state":["exists","up"]},{"osd":1,"uuid":"e40c68c3-96c6-45e5-875a-cd0b65d215ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6811","nonce":4131031317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6813","nonce":4131031317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6817","nonce":4131031317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":4131031317},{"type":"v1","addr":"172.21.15.80:6815","nonce":4131031317}]},"public_addr":"172.21.15.80:6811/4131031317","cluster_addr":"172.21.15.80:6813/4131031317","heartbeat_back_addr":"172.21.15.80:6817/4131031317","heartbeat_front_addr":"172.21.15.80:6815/4131031317","state":["exists","up"]},{"osd":2,"uuid":"8761092d-c3ee-4a24-9d86-39182ffb54e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6819","nonce":1036175868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6821","nonce":1036175868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6825","nonce":1036175868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1036175868},{"type":"v1","addr":"172.21.15.80:6823","nonce":1036175868}]},"public_addr":"172.21.15.80:6819/1036175868","cluster_addr":"172.21.15.80:6821/1036175868","heartbeat_back_addr":"172.21.15.80:6825/1036175868","heartbeat_front_addr":"172.21.15.80:6823/1036175868","state":["exists","up"]},{"osd":3,"uuid":"1daf8576-7e1e-44cc-8477-c8108442dd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6827","nonce":1868846440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6829","nonce":1868846440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6833","nonce":1868846440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":1868846440},{"type":"v1","addr":"172.21.15.80:6831","nonce":1868846440}]},"public_addr":"172.21.15.80:6827/1868846440","cluster_addr":"172.21.15.80:6829/1868846440","heartbeat_back_addr":"172.21.15.80:6833/1868846440","heartbeat_front_addr":"172.21.15.80:6831/1868846440","state":["exists","up"]},{"osd":4,"uuid":"a2c86a3c-7c72-4f55-bf73-9ec14d925b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6801","nonce":2703158768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6803","nonce":2703158768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6807","nonce":2703158768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2703158768},{"type":"v1","addr":"172.21.15.195:6805","nonce":2703158768}]},"public_addr":"172.21.15.195:6801/2703158768","cluster_addr":"172.21.15.195:6803/2703158768","heartbeat_back_addr":"172.21.15.195:6807/2703158768","heartbeat_front_addr":"172.21.15.195:6805/2703158768","state":["exists","up"]},{"osd":5,"uuid":"20fb8ae4-0923-4d21-936c-8c8ebbc279f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6809","nonce":1748131419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6811","nonce":1748131419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6815","nonce":1748131419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1748131419},{"type":"v1","addr":"172.21.15.195:6813","nonce":1748131419}]},"public_addr":"172.21.15.195:6809/1748131419","cluster_addr":"172.21.15.195:6811/1748131419","heartbeat_back_addr":"172.21.15.195:6815/1748131419","heartbeat_front_addr":"172.21.15.195:6813/1748131419","state":["exists","up"]},{"osd":6,"uuid":"3e78aad1-ff7d-47d1-aabf-a437f0a10df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6817","nonce":129712859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6819","nonce":129712859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6823","nonce":129712859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":129712859},{"type":"v1","addr":"172.21.15.195:6821","nonce":129712859}]},"public_addr":"172.21.15.195:6817/129712859","cluster_addr":"172.21.15.195:6819/129712859","heartbeat_back_addr":"172.21.15.195:6823/129712859","heartbeat_front_addr":"172.21.15.195:6821/129712859","state":["exists","up"]},{"osd":7,"uuid":"77f80413-d084-4cd8-a2d3-37352ceb17a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6825","nonce":768760592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6827","nonce":768760592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6831","nonce":768760592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":768760592},{"type":"v1","addr":"172.21.15.195:6829","nonce":768760592}]},"public_addr":"172.21.15.195:6825/768760592","cluster_addr":"172.21.15.195:6827/768760592","heartbeat_back_addr":"172.21.15.195:6831/768760592","heartbeat_front_addr":"172.21.15.195:6829/768760592","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:39:17.380267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:39:43.857337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:09.754817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:35.260189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:40:56.755201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:41:23.441276+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:41:50.009201+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T07:42:14.757799+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.80:6800/1935270641":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/2682865589":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/876829809":"2024-01-22T07:37:18.988155+0000","172.21.15.80:6800/941119075":"2024-01-22T07:37:02.648111+0000","172.21.15.80:6801/1935270641":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/3112152988":"2024-01-22T07:37:02.648111+0000","172.21.15.80:0/927839510":"2024-01-22T07:37:18.988155+0000","172.21.15.80:0/1525539124":"2024-01-22T07:37:02.648111+0000","172.21.15.80:6801/941119075":"2024-01-22T07:37:02.648111+0000","172.21.15.80:0/2682426603":"2024-01-22T07:37:02.648111+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-01-21T07:43:01.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:01 smithi080 bash[13909]: audit 2024-01-21T07:43:01.113218+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.80:0/1841597991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:43:01.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:01 smithi080 bash[17460]: audit 2024-01-21T07:43:01.113218+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.80:0/1841597991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:43:01.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:01 smithi195 bash[13978]: audit 2024-01-21T07:43:01.113218+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.80:0/1841597991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-21T07:43:01.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-01-21T07:43:02.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:02 smithi080 bash[13909]: cluster 2024-01-21T07:43:01.753987+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:02.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:02 smithi080 bash[17460]: cluster 2024-01-21T07:43:01.753987+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:02.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:02 smithi195 bash[13978]: cluster 2024-01-21T07:43:01.753987+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:04.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:04 smithi080 bash[26471]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:04.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:04 smithi080 bash[26471]: See 'docker run --help'. 2024-01-21T07:43:04.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:04 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:04.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:04 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-21T07:43:04.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:04 smithi080 bash[13909]: cluster 2024-01-21T07:43:03.754684+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:04.848 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:04 smithi080 bash[17460]: cluster 2024-01-21T07:43:03.754684+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:05.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:04 smithi195 bash[13978]: cluster 2024-01-21T07:43:03.754684+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:05.476 INFO:teuthology.orchestra.run.smithi080.stdout:42949673007 2024-01-21T07:43:05.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-01-21T07:43:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:05 smithi195 bash[13978]: cluster 2024-01-21T07:43:05.755297+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:06.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:05 smithi080 bash[13909]: cluster 2024-01-21T07:43:05.755297+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:06.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:05 smithi080 bash[17460]: cluster 2024-01-21T07:43:05.755297+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:07.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:06 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 3. 2024-01-21T07:43:07.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:06 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:07.388 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:06 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:07.388 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:06 smithi195 docker[22480]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:43:07.388 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:06 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:07.388 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:06 smithi195 bash[22503]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:08.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:07 smithi195 bash[13978]: cluster 2024-01-21T07:43:07.755914+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:08.157 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:07 smithi080 bash[13909]: cluster 2024-01-21T07:43:07.755914+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:08.158 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:07 smithi080 bash[17460]: cluster 2024-01-21T07:43:07.755914+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:08.813 INFO:teuthology.orchestra.run.smithi080.stdout:68719476778 2024-01-21T07:43:08.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-01-21T07:43:09.891 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:09 smithi080 bash[13909]: cluster 2024-01-21T07:43:09.756509+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:09.891 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:09 smithi080 bash[17460]: cluster 2024-01-21T07:43:09.756509+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:10.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:09 smithi195 bash[13978]: cluster 2024-01-21T07:43:09.756509+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:11.305 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:11 smithi195 bash[22503]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:11.305 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:11 smithi195 bash[22503]: See 'docker run --help'. 2024-01-21T07:43:11.305 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:11 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:11.305 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:11 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:43:11.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:11 smithi195 bash[13978]: cluster 2024-01-21T07:43:11.757127+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:11.986 INFO:teuthology.orchestra.run.smithi080.stdout:90194313254 2024-01-21T07:43:11.987 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-01-21T07:43:12.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:11 smithi080 bash[13909]: cluster 2024-01-21T07:43:11.757127+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:12.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:11 smithi080 bash[17460]: cluster 2024-01-21T07:43:11.757127+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:14.379 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:14 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Scheduled restart job, restart counter is at 3. 2024-01-21T07:43:14.380 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:14 smithi080 systemd[1]: Stopped Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:14.380 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:14 smithi080 systemd[1]: Starting Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:14.380 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:14 smithi080 docker[27204]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.a 2024-01-21T07:43:14.380 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:14 smithi080 systemd[1]: Started Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:14.380 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[27215]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:14.569 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:14 smithi195 docker[22708]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-grafana.a 2024-01-21T07:43:14.569 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:14 smithi195 systemd[1]: Started Ceph grafana.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:14.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:14 smithi195 bash[13978]: cluster 2024-01-21T07:43:13.757707+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:14.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:14 smithi195 bash[13978]: audit 2024-01-21T07:43:14.193962+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:43:14.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:14 smithi195 bash[13978]: audit 2024-01-21T07:43:14.200411+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:43:14.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:14 smithi195 bash[13978]: audit 2024-01-21T07:43:14.201910+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:43:14.944 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[13909]: cluster 2024-01-21T07:43:13.757707+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:14.944 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[13909]: audit 2024-01-21T07:43:14.193962+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:43:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[13909]: audit 2024-01-21T07:43:14.200411+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:43:15.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[13909]: audit 2024-01-21T07:43:14.201910+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:43:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[17460]: cluster 2024-01-21T07:43:13.757707+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[17460]: audit 2024-01-21T07:43:14.193962+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:43:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[17460]: audit 2024-01-21T07:43:14.200411+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.222982\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223180\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223306\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223428\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223548\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223668\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:34.223789\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:43:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:14 smithi080 bash[17460]: audit 2024-01-21T07:43:14.201910+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-01-21T07:43:15.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="App mode production" logger=settings 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Initializing SqlStore" logger=server 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Starting DB migration" logger=migrator 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-01-21T07:43:15.251 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-01-21T07:43:15.287 INFO:teuthology.orchestra.run.smithi080.stdout:115964117027 2024-01-21T07:43:15.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-01-21T07:43:15.536 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-01-21T07:43:15.537 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-01-21T07:43:15.537 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-01-21T07:43:15.537 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-01-21T07:43:15.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-01-21T07:43:15.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-01-21T07:43:15.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-01-21T07:43:15.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-01-21T07:43:15.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-01-21T07:43:15.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[13978]: audit 2024-01-21T07:43:15.292824+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_daemon_update\": \"2024-01-21T07:43:15.291147\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:43:15.831 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[13978]: audit 2024-01-21T07:43:15.299503+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_daemon_update\": \"2024-01-21T07:43:15.291147\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:43:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:15 smithi080 bash[13909]: audit 2024-01-21T07:43:15.292824+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_daemon_update\": \"2024-01-21T07:43:15.291147\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:43:16.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:15 smithi080 bash[13909]: audit 2024-01-21T07:43:15.299503+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_daemon_update\": \"2024-01-21T07:43:15.291147\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:43:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:15 smithi080 bash[17460]: audit 2024-01-21T07:43:15.292824+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_daemon_update\": \"2024-01-21T07:43:15.291147\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:43:16.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:15 smithi080 bash[17460]: audit 2024-01-21T07:43:15.299503+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}}, \"last_daemon_update\": \"2024-01-21T07:43:15.291147\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:43:16.106 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-01-21T07:43:16.107 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:15 smithi195 bash[22730]: t=2024-01-21T07:43:15+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-01-21T07:43:16.107 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-01-21T07:43:16.107 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-01-21T07:43:16.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-01-21T07:43:16.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-01-21T07:43:16.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-01-21T07:43:16.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-01-21T07:43:16.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-01-21T07:43:16.686 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-01-21T07:43:16.686 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-01-21T07:43:16.686 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-01-21T07:43:16.686 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-01-21T07:43:16.686 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-01-21T07:43:16.686 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-01-21T07:43:16.963 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[13978]: cephadm 2024-01-21T07:43:15.307115+0000 mgr.y (mgr.14140) 236 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:16.963 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[13978]: cluster 2024-01-21T07:43:15.758223+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:16.963 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-01-21T07:43:16.963 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-01-21T07:43:16.963 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-01-21T07:43:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:16 smithi080 bash[13909]: cephadm 2024-01-21T07:43:15.307115+0000 mgr.y (mgr.14140) 236 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:17.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:16 smithi080 bash[13909]: cluster 2024-01-21T07:43:15.758223+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:17.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:16 smithi080 bash[17460]: cephadm 2024-01-21T07:43:15.307115+0000 mgr.y (mgr.14140) 236 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:17.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:16 smithi080 bash[17460]: cluster 2024-01-21T07:43:15.758223+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:17.215 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:16 smithi195 bash[22730]: t=2024-01-21T07:43:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-01-21T07:43:17.215 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-01-21T07:43:17.215 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-01-21T07:43:17.215 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-01-21T07:43:17.215 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-01-21T07:43:17.215 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-01-21T07:43:17.483 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-01-21T07:43:17.483 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-01-21T07:43:17.483 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-01-21T07:43:17.768 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-01-21T07:43:17.768 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-01-21T07:43:17.769 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-01-21T07:43:17.769 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-01-21T07:43:17.769 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-01-21T07:43:17.769 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-01-21T07:43:18.020 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-01-21T07:43:18.020 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-01-21T07:43:18.020 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:17 smithi195 bash[22730]: t=2024-01-21T07:43:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-01-21T07:43:18.210 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:17 smithi080 bash[27215]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:18.211 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:17 smithi080 bash[27215]: See 'docker run --help'. 2024-01-21T07:43:18.211 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:17 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:18.211 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:17 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-21T07:43:18.280 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-01-21T07:43:18.280 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-01-21T07:43:18.280 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-01-21T07:43:18.280 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-01-21T07:43:18.280 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-01-21T07:43:18.532 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-01-21T07:43:18.532 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-01-21T07:43:18.532 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-01-21T07:43:18.824 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[13978]: cluster 2024-01-21T07:43:17.758831+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:18.825 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-01-21T07:43:18.825 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-01-21T07:43:18.825 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-01-21T07:43:18.825 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-01-21T07:43:18.864 INFO:teuthology.orchestra.run.smithi080.stdout:137438953502 2024-01-21T07:43:18.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-01-21T07:43:19.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:18 smithi080 bash[13909]: cluster 2024-01-21T07:43:17.758831+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:19.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:18 smithi080 bash[17460]: cluster 2024-01-21T07:43:17.758831+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:19.118 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-01-21T07:43:19.118 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:18 smithi195 bash[22730]: t=2024-01-21T07:43:18+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-01-21T07:43:19.118 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-01-21T07:43:19.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: debug 2024-01-21T07:43:19.135+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:19.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:19.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:19.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:19.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-01-21T07:43:19.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-01-21T07:43:19.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-01-21T07:43:19.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-01-21T07:43:19.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-01-21T07:43:19.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-01-21T07:43:19.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-01-21T07:43:19.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-01-21T07:43:19.932 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-01-21T07:43:19.932 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-01-21T07:43:19.932 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-01-21T07:43:19.932 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: cephadm 2024-01-21T07:43:19.138604+0000 mgr.y (mgr.14140) 239 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:19.933 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.934 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: cephadm 2024-01-21T07:43:19.138900+0000 mgr.y (mgr.14140) 240 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:19.935 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:19.936 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:19.937 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:19.937 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: cephadm 2024-01-21T07:43:19.147452+0000 mgr.y (mgr.14140) 241 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:19.937 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[13978]: cluster 2024-01-21T07:43:19.759361+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: cephadm 2024-01-21T07:43:19.138604+0000 mgr.y (mgr.14140) 239 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:20.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:20.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: cephadm 2024-01-21T07:43:19.138604+0000 mgr.y (mgr.14140) 239 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:20.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:20.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:20.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: cephadm 2024-01-21T07:43:19.138900+0000 mgr.y (mgr.14140) 240 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:20.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: cephadm 2024-01-21T07:43:19.147452+0000 mgr.y (mgr.14140) 241 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[13909]: cluster 2024-01-21T07:43:19.759361+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: cephadm 2024-01-21T07:43:19.138900+0000 mgr.y (mgr.14140) 240 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:20.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: cephadm 2024-01-21T07:43:19.147452+0000 mgr.y (mgr.14140) 241 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:20.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:19 smithi080 bash[17460]: cluster 2024-01-21T07:43:19.759361+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:20.192 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:19 smithi195 bash[22730]: t=2024-01-21T07:43:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-01-21T07:43:20.192 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-01-21T07:43:20.192 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-01-21T07:43:20.192 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-01-21T07:43:20.468 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-01-21T07:43:20.468 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-01-21T07:43:20.468 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-01-21T07:43:20.469 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-01-21T07:43:20.469 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-01-21T07:43:20.770 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-01-21T07:43:20.770 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-01-21T07:43:20.770 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-01-21T07:43:21.037 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-01-21T07:43:21.038 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-01-21T07:43:21.038 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-01-21T07:43:21.038 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:20 smithi195 bash[22730]: t=2024-01-21T07:43:20+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-01-21T07:43:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:21 smithi080 bash[13909]: audit 2024-01-21T07:43:20.979137+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi195:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:43:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:21 smithi080 bash[13909]: audit 2024-01-21T07:43:20.987141+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi195:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-01-21T07:43:21.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:21 smithi080 bash[17460]: audit 2024-01-21T07:43:20.979137+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi195:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:43:21.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:21 smithi080 bash[17460]: audit 2024-01-21T07:43:20.987141+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi195:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: debug 2024-01-21T07:43:20.971+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:21.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:21.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:21.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:21.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:21.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:20 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:21.339 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[13978]: audit 2024-01-21T07:43:20.979137+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi195:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:43:21.339 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[13978]: audit 2024-01-21T07:43:20.987141+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi195:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-01-21T07:43:21.339 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-01-21T07:43:21.339 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-01-21T07:43:21.340 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-01-21T07:43:21.340 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:21 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 4. 2024-01-21T07:43:21.340 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:21 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:21.340 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:21 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:21.340 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:21 smithi195 docker[22974]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:43:21.340 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:21 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:21.340 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22995]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:21.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-01-21T07:43:21.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-01-21T07:43:21.638 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-01-21T07:43:21.638 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-01-21T07:43:21.638 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-01-21T07:43:21.969 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-01-21T07:43:21.969 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-01-21T07:43:21.969 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-01-21T07:43:21.969 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-01-21T07:43:21.969 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-01-21T07:43:22.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:21 smithi195 bash[22730]: t=2024-01-21T07:43:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-01-21T07:43:22.250 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-01-21T07:43:22.250 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: cephadm 2024-01-21T07:43:20.976314+0000 mgr.y (mgr.14140) 243 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.250 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.250 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.250 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.250 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.250 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.251 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.252 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: cephadm 2024-01-21T07:43:20.976586+0000 mgr.y (mgr.14140) 244 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.253 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: cephadm 2024-01-21T07:43:20.978584+0000 mgr.y (mgr.14140) 245 : cephadm [INF] Setting dashboard grafana config to https://smithi195:3000 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: cephadm 2024-01-21T07:43:20.995111+0000 mgr.y (mgr.14140) 246 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:22.254 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[13978]: cluster 2024-01-21T07:43:21.759866+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: cephadm 2024-01-21T07:43:20.976314+0000 mgr.y (mgr.14140) 243 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:22.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:22.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: cephadm 2024-01-21T07:43:20.976314+0000 mgr.y (mgr.14140) 243 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:22.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: cephadm 2024-01-21T07:43:20.976586+0000 mgr.y (mgr.14140) 244 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: cephadm 2024-01-21T07:43:20.978584+0000 mgr.y (mgr.14140) 245 : cephadm [INF] Setting dashboard grafana config to https://smithi195:3000 2024-01-21T07:43:22.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: cephadm 2024-01-21T07:43:20.995111+0000 mgr.y (mgr.14140) 246 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[13909]: cluster 2024-01-21T07:43:21.759866+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: cephadm 2024-01-21T07:43:20.976586+0000 mgr.y (mgr.14140) 244 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:22.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: cephadm 2024-01-21T07:43:20.978584+0000 mgr.y (mgr.14140) 245 : cephadm [INF] Setting dashboard grafana config to https://smithi195:3000 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: cephadm 2024-01-21T07:43:20.995111+0000 mgr.y (mgr.14140) 246 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:22.317 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[17460]: cluster 2024-01-21T07:43:21.759866+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:22.539 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-01-21T07:43:22.539 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-01-21T07:43:22.539 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-01-21T07:43:22.539 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-01-21T07:43:22.540 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22995]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.540 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22995]: See 'docker run --help'. 2024-01-21T07:43:22.540 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:22 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:22.540 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:22 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: debug 2024-01-21T07:43:22.331+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:22.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:22.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:22.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:22 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:22.686 INFO:teuthology.orchestra.run.smithi080.stdout:163208757274 2024-01-21T07:43:22.686 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-01-21T07:43:22.833 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-01-21T07:43:22.833 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-01-21T07:43:22.833 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-01-21T07:43:22.833 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-01-21T07:43:23.110 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-01-21T07:43:23.110 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-01-21T07:43:23.110 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-01-21T07:43:23.110 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:22 smithi195 bash[22730]: t=2024-01-21T07:43:22+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-01-21T07:43:23.110 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-01-21T07:43:23.111 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-01-21T07:43:23.111 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: cephadm 2024-01-21T07:43:22.335711+0000 mgr.y (mgr.14140) 248 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.111 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.111 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.111 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.111 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.111 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:43:23.112 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:23.113 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: cephadm 2024-01-21T07:43:22.336009+0000 mgr.y (mgr.14140) 249 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.114 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.115 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:23.115 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:23.115 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.115 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[13978]: cephadm 2024-01-21T07:43:22.344221+0000 mgr.y (mgr.14140) 250 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: cephadm 2024-01-21T07:43:22.335711+0000 mgr.y (mgr.14140) 248 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:23.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: cephadm 2024-01-21T07:43:22.336009+0000 mgr.y (mgr.14140) 249 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[17460]: cephadm 2024-01-21T07:43:22.344221+0000 mgr.y (mgr.14140) 250 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: cephadm 2024-01-21T07:43:22.335711+0000 mgr.y (mgr.14140) 248 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: cephadm 2024-01-21T07:43:22.336009+0000 mgr.y (mgr.14140) 249 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:23.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:23 smithi080 bash[13909]: cephadm 2024-01-21T07:43:22.344221+0000 mgr.y (mgr.14140) 250 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:23.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-01-21T07:43:23.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-01-21T07:43:23.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-01-21T07:43:23.387 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-01-21T07:43:23.688 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-01-21T07:43:23.689 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-01-21T07:43:23.689 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-01-21T07:43:23.689 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-01-21T07:43:23.689 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-01-21T07:43:23.956 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-01-21T07:43:23.956 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-01-21T07:43:24.258 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:23 smithi195 bash[22730]: t=2024-01-21T07:43:23+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-01-21T07:43:24.258 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-01-21T07:43:24.258 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-01-21T07:43:24.258 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-01-21T07:43:24.258 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-01-21T07:43:24.543 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-01-21T07:43:24.544 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-01-21T07:43:24.544 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-01-21T07:43:24.544 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-01-21T07:43:24.544 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-01-21T07:43:24.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:24 smithi080 bash[13909]: cluster 2024-01-21T07:43:23.760543+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:24.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:24 smithi080 bash[17460]: cluster 2024-01-21T07:43:23.760543+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:24.829 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[13978]: cluster 2024-01-21T07:43:23.760543+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:24.829 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-01-21T07:43:24.829 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-01-21T07:43:24.829 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-01-21T07:43:24.829 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-01-21T07:43:24.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-01-21T07:43:24.830 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-01-21T07:43:25.081 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-01-21T07:43:25.081 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:24 smithi195 bash[22730]: t=2024-01-21T07:43:24+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-01-21T07:43:25.081 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-01-21T07:43:25.366 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-01-21T07:43:25.366 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-01-21T07:43:25.366 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-01-21T07:43:25.366 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-01-21T07:43:25.366 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-01-21T07:43:25.367 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-01-21T07:43:25.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-01-21T07:43:25.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-01-21T07:43:25.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-01-21T07:43:25.911 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[13978]: cluster 2024-01-21T07:43:25.761186+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:25.911 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-01-21T07:43:25.911 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-01-21T07:43:25.911 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-01-21T07:43:25.911 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-01-21T07:43:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:25 smithi080 bash[13909]: cluster 2024-01-21T07:43:25.761186+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:26.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:25 smithi080 bash[17460]: cluster 2024-01-21T07:43:25.761186+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:26.177 INFO:teuthology.orchestra.run.smithi080.stdout:184683593749 2024-01-21T07:43:26.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-01-21T07:43:26.187 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-01-21T07:43:26.187 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:25 smithi195 bash[22730]: t=2024-01-21T07:43:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-01-21T07:43:26.188 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-01-21T07:43:26.188 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-01-21T07:43:26.472 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-01-21T07:43:26.472 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-01-21T07:43:26.472 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-01-21T07:43:26.473 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: debug 2024-01-21T07:43:26.243+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:26.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:26.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:26.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:26.732 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-01-21T07:43:26.732 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-01-21T07:43:26.732 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-01-21T07:43:26.732 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-01-21T07:43:27.001 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-01-21T07:43:27.001 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-01-21T07:43:27.001 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-01-21T07:43:27.001 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-01-21T07:43:27.001 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[22730]: t=2024-01-21T07:43:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: cephadm 2024-01-21T07:43:26.247943+0000 mgr.y (mgr.14140) 253 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:27.002 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.003 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.004 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: cephadm 2024-01-21T07:43:26.248132+0000 mgr.y (mgr.14140) 254 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:27.005 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:27.006 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.006 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:26 smithi195 bash[13978]: cephadm 2024-01-21T07:43:26.254049+0000 mgr.y (mgr.14140) 255 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:27.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: cephadm 2024-01-21T07:43:26.247943+0000 mgr.y (mgr.14140) 253 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.100 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:27.101 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: cephadm 2024-01-21T07:43:26.248132+0000 mgr.y (mgr.14140) 254 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.103 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.104 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[17460]: cephadm 2024-01-21T07:43:26.254049+0000 mgr.y (mgr.14140) 255 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: cephadm 2024-01-21T07:43:26.247943+0000 mgr.y (mgr.14140) 253 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:27.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: cephadm 2024-01-21T07:43:26.248132+0000 mgr.y (mgr.14140) 254 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:27.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:27.110 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:26 smithi080 bash[13909]: cephadm 2024-01-21T07:43:26.254049+0000 mgr.y (mgr.14140) 255 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:43:27.260 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-01-21T07:43:27.261 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-01-21T07:43:27.261 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-01-21T07:43:27.261 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-01-21T07:43:27.554 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-01-21T07:43:27.554 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-01-21T07:43:27.554 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-01-21T07:43:27.554 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-01-21T07:43:27.554 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-01-21T07:43:27.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-01-21T07:43:27.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-01-21T07:43:27.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-01-21T07:43:28.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[13978]: cluster 2024-01-21T07:43:27.761771+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:28.133 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-01-21T07:43:28.133 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-01-21T07:43:28.133 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:27 smithi195 bash[22730]: t=2024-01-21T07:43:27+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-01-21T07:43:28.133 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-01-21T07:43:28.133 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-01-21T07:43:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:27 smithi080 bash[13909]: cluster 2024-01-21T07:43:27.761771+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:28.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:27 smithi080 bash[17460]: cluster 2024-01-21T07:43:27.761771+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:28.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:27 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Scheduled restart job, restart counter is at 4. 2024-01-21T07:43:28.308 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:27 smithi080 systemd[1]: Stopped Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:28.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:27 smithi080 systemd[1]: Starting Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:28.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:27 smithi080 docker[27965]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.a 2024-01-21T07:43:28.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:27 smithi080 systemd[1]: Started Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:28.309 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:27 smithi080 bash[27976]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:28.384 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-01-21T07:43:28.384 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-01-21T07:43:28.384 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-01-21T07:43:28.385 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-01-21T07:43:28.385 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-01-21T07:43:28.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-01-21T07:43:28.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-01-21T07:43:28.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-01-21T07:43:28.637 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-01-21T07:43:29.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-01-21T07:43:29.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-01-21T07:43:29.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-01-21T07:43:29.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-01-21T07:43:29.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:28 smithi195 bash[22730]: t=2024-01-21T07:43:28+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-01-21T07:43:29.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-01-21T07:43:29.307 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-01-21T07:43:29.307 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-01-21T07:43:29.308 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-01-21T07:43:29.308 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-01-21T07:43:29.308 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-01-21T07:43:29.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:29 smithi080 bash[27976]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:29.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:29 smithi080 bash[27976]: See 'docker run --help'. 2024-01-21T07:43:29.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:29 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:29.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:29 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-21T07:43:29.601 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-01-21T07:43:29.601 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-01-21T07:43:29.601 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-01-21T07:43:29.601 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-01-21T07:43:29.759 INFO:teuthology.orchestra.run.smithi080.stdout:206158430225 2024-01-21T07:43:29.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-01-21T07:43:29.883 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[13978]: cluster 2024-01-21T07:43:29.762300+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:29.884 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-01-21T07:43:29.884 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-01-21T07:43:29.884 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-01-21T07:43:29.884 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-01-21T07:43:30.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:29 smithi080 bash[13909]: cluster 2024-01-21T07:43:29.762300+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:30.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:29 smithi080 bash[17460]: cluster 2024-01-21T07:43:29.762300+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:30.137 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:29 smithi195 bash[22730]: t=2024-01-21T07:43:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-01-21T07:43:30.137 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-01-21T07:43:30.137 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-01-21T07:43:30.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: debug 2024-01-21T07:43:30.135+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:30.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:30.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:30.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:30.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:30.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-01-21T07:43:30.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-01-21T07:43:30.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-01-21T07:43:30.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-01-21T07:43:30.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-01-21T07:43:30.838 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing HTTPServer" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing PluginManager" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Starting plugin search" logger=plugins 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing HooksService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing RemoteCache" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing QuotaService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing ServerLockService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing RenderingService" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing AlertEngine" logger=server 2024-01-21T07:43:30.839 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing LoginService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing SearchService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing TracingService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing CleanUpService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing NotificationService" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="Initializing Stream Manager" 2024-01-21T07:43:30.840 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[22730]: t=2024-01-21T07:43:30+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: cephadm 2024-01-21T07:43:30.137960+0000 mgr.y (mgr.14140) 258 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: cephadm 2024-01-21T07:43:30.137960+0000 mgr.y (mgr.14140) 258 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:31.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: cephadm 2024-01-21T07:43:30.138260+0000 mgr.y (mgr.14140) 259 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[13909]: cephadm 2024-01-21T07:43:30.146945+0000 mgr.y (mgr.14140) 260 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: cephadm 2024-01-21T07:43:30.138260+0000 mgr.y (mgr.14140) 259 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:30 smithi080 bash[17460]: cephadm 2024-01-21T07:43:30.146945+0000 mgr.y (mgr.14140) 260 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:31.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: cephadm 2024-01-21T07:43:30.137960+0000 mgr.y (mgr.14140) 258 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: cephadm 2024-01-21T07:43:30.138260+0000 mgr.y (mgr.14140) 259 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:31.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:31.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:43:31.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:30 smithi195 bash[13978]: cephadm 2024-01-21T07:43:30.146945+0000 mgr.y (mgr.14140) 260 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:43:32.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:31 smithi080 bash[13909]: cluster 2024-01-21T07:43:31.762886+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:32.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:31 smithi080 bash[17460]: cluster 2024-01-21T07:43:31.762886+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:32.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:31 smithi195 bash[13978]: cluster 2024-01-21T07:43:31.762886+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:32.628 INFO:teuthology.orchestra.run.smithi080.stdout:42949673013 2024-01-21T07:43:33.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:32 smithi080 bash[13909]: audit 2024-01-21T07:43:32.626959+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.80:0/508905083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-21T07:43:33.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:32 smithi080 bash[17460]: audit 2024-01-21T07:43:32.626959+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.80:0/508905083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-21T07:43:33.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:32 smithi195 bash[13978]: audit 2024-01-21T07:43:32.626959+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.80:0/508905083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-21T07:43:33.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:32 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 5. 2024-01-21T07:43:33.137 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:32 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:33.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:32 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:33.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:32 smithi195 docker[23040]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:43:33.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:32 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:33.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:32 smithi195 bash[23056]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:33.273 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673007 got 42949673013 for osd.0 2024-01-21T07:43:33.273 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: debug 2024-01-21T07:43:34.199+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:34.435 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:34.436 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:43:34.437 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:43:34.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:34.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[13909]: cluster 2024-01-21T07:43:33.763443+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:34.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:34 smithi080 bash[17460]: cluster 2024-01-21T07:43:33.763443+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:35.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:34 smithi195 bash[13978]: cluster 2024-01-21T07:43:33.763443+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:36.026 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: cephadm 2024-01-21T07:43:34.206285+0000 mgr.y (mgr.14140) 263 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.027 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.028 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: cephadm 2024-01-21T07:43:34.206611+0000 mgr.y (mgr.14140) 264 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.029 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:43:36.030 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: cephadm 2024-01-21T07:43:34.206285+0000 mgr.y (mgr.14140) 263 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: cephadm 2024-01-21T07:43:34.206611+0000 mgr.y (mgr.14140) 264 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:43:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:35 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: cephadm 2024-01-21T07:43:34.206285+0000 mgr.y (mgr.14140) 263 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:36.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: cephadm 2024-01-21T07:43:34.206611+0000 mgr.y (mgr.14140) 264 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.135 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:43:36.136 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:35 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:43:36.369 INFO:teuthology.orchestra.run.smithi080.stdout:68719476783 2024-01-21T07:43:36.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:36 smithi195 bash[23056]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:36.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:36 smithi195 bash[23056]: See 'docker run --help'. 2024-01-21T07:43:36.387 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:36 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:36.388 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:36 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:43:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:36 smithi080 bash[13909]: cluster 2024-01-21T07:43:35.764005+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:37.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:36 smithi080 bash[13909]: audit 2024-01-21T07:43:36.367472+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.80:0/1934972747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-21T07:43:37.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:36 smithi080 bash[17460]: cluster 2024-01-21T07:43:35.764005+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:37.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:36 smithi080 bash[17460]: audit 2024-01-21T07:43:36.367472+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.80:0/1934972747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-21T07:43:37.105 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476778 got 68719476783 for osd.1 2024-01-21T07:43:37.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-01-21T07:43:37.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:36 smithi195 bash[13978]: cluster 2024-01-21T07:43:35.764005+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:36 smithi195 bash[13978]: audit 2024-01-21T07:43:36.367472+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.80:0/1934972747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-21T07:43:39.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:38 smithi080 bash[13909]: cluster 2024-01-21T07:43:37.764561+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:39.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:38 smithi080 bash[17460]: cluster 2024-01-21T07:43:37.764561+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:39.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:38 smithi195 bash[13978]: cluster 2024-01-21T07:43:37.764561+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:39.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:39 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Scheduled restart job, restart counter is at 5. 2024-01-21T07:43:39.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:39 smithi080 systemd[1]: Stopped Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:39.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:39 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Start request repeated too quickly. 2024-01-21T07:43:39.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:39 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-21T07:43:39.558 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Jan 21 07:43:39 smithi080 systemd[1]: Failed to start Ceph node-exporter.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:39.908 INFO:teuthology.orchestra.run.smithi080.stdout:90194313260 2024-01-21T07:43:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:39 smithi080 bash[13909]: cluster 2024-01-21T07:43:39.765106+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:40.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:39 smithi080 bash[17460]: cluster 2024-01-21T07:43:39.765106+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:39 smithi195 bash[13978]: cluster 2024-01-21T07:43:39.765106+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:40.625 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313254 got 90194313260 for osd.2 2024-01-21T07:43:40.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-01-21T07:43:41.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:40 smithi080 bash[13909]: audit 2024-01-21T07:43:39.907089+0000 mon.a (mon.0) 501 : audit [DBG] from='client.? 172.21.15.80:0/3727613979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-21T07:43:41.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:40 smithi080 bash[17460]: audit 2024-01-21T07:43:39.907089+0000 mon.a (mon.0) 501 : audit [DBG] from='client.? 172.21.15.80:0/3727613979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-21T07:43:41.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:40 smithi195 bash[13978]: audit 2024-01-21T07:43:39.907089+0000 mon.a (mon.0) 501 : audit [DBG] from='client.? 172.21.15.80:0/3727613979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-21T07:43:42.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:41 smithi195 bash[13978]: cluster 2024-01-21T07:43:41.765618+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:42.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:41 smithi080 bash[13909]: cluster 2024-01-21T07:43:41.765618+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:42.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:41 smithi080 bash[17460]: cluster 2024-01-21T07:43:41.765618+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:43.291 INFO:teuthology.orchestra.run.smithi080.stdout:115964117032 2024-01-21T07:43:43.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:43 smithi195 bash[13978]: audit 2024-01-21T07:43:43.289416+0000 mon.a (mon.0) 502 : audit [DBG] from='client.? 172.21.15.80:0/2759139933' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-21T07:43:43.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:43 smithi080 bash[13909]: audit 2024-01-21T07:43:43.289416+0000 mon.a (mon.0) 502 : audit [DBG] from='client.? 172.21.15.80:0/2759139933' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-21T07:43:43.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:43 smithi080 bash[17460]: audit 2024-01-21T07:43:43.289416+0000 mon.a (mon.0) 502 : audit [DBG] from='client.? 172.21.15.80:0/2759139933' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-21T07:43:44.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117027 got 115964117032 for osd.3 2024-01-21T07:43:44.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-01-21T07:43:45.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:44 smithi080 bash[13909]: cluster 2024-01-21T07:43:43.766184+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:45.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:44 smithi080 bash[17460]: cluster 2024-01-21T07:43:43.766184+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:45.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:44 smithi195 bash[13978]: cluster 2024-01-21T07:43:43.766184+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:45 smithi080 bash[13909]: cluster 2024-01-21T07:43:45.766842+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:46.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:45 smithi080 bash[17460]: cluster 2024-01-21T07:43:45.766842+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:46.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:45 smithi195 bash[13978]: cluster 2024-01-21T07:43:45.766842+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:46.690 INFO:teuthology.orchestra.run.smithi080.stdout:137438953508 2024-01-21T07:43:46.839 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:46 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 6. 2024-01-21T07:43:46.839 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:46 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:46.839 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:46 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:43:46.839 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:46 smithi195 docker[23075]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:43:46.839 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:46 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:43:46.839 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:46 smithi195 bash[23095]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:43:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:46 smithi080 bash[13909]: audit 2024-01-21T07:43:46.688906+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.80:0/1528008450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-21T07:43:47.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:46 smithi080 bash[17460]: audit 2024-01-21T07:43:46.688906+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.80:0/1528008450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-21T07:43:47.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:46 smithi195 bash[13978]: audit 2024-01-21T07:43:46.688906+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.80:0/1528008450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-21T07:43:47.327 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953502 got 137438953508 for osd.4 2024-01-21T07:43:47.328 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-01-21T07:43:48.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:47 smithi195 bash[13978]: cluster 2024-01-21T07:43:47.767562+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:48.145 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:47 smithi080 bash[13909]: cluster 2024-01-21T07:43:47.767562+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:48.145 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:47 smithi080 bash[17460]: cluster 2024-01-21T07:43:47.767562+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:49.935 INFO:teuthology.orchestra.run.smithi080.stdout:163208757279 2024-01-21T07:43:49.982 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:49 smithi080 bash[17460]: cluster 2024-01-21T07:43:49.768105+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:49.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:49 smithi080 bash[13909]: cluster 2024-01-21T07:43:49.768105+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:50.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:49 smithi195 bash[13978]: cluster 2024-01-21T07:43:49.768105+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:50.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:49 smithi195 bash[23095]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:43:50.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:49 smithi195 bash[23095]: See 'docker run --help'. 2024-01-21T07:43:50.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:49 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:43:50.138 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:43:49 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:43:50.632 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757274 got 163208757279 for osd.5 2024-01-21T07:43:50.632 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-01-21T07:43:51.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:50 smithi080 bash[13909]: audit 2024-01-21T07:43:49.934215+0000 mon.a (mon.0) 503 : audit [DBG] from='client.? 172.21.15.80:0/3779116820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-21T07:43:51.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:50 smithi080 bash[17460]: audit 2024-01-21T07:43:49.934215+0000 mon.a (mon.0) 503 : audit [DBG] from='client.? 172.21.15.80:0/3779116820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-21T07:43:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:50 smithi195 bash[13978]: audit 2024-01-21T07:43:49.934215+0000 mon.a (mon.0) 503 : audit [DBG] from='client.? 172.21.15.80:0/3779116820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-21T07:43:52.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:51 smithi195 bash[13978]: cluster 2024-01-21T07:43:51.768672+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:52.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:51 smithi080 bash[13909]: cluster 2024-01-21T07:43:51.768672+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:52.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:51 smithi080 bash[17460]: cluster 2024-01-21T07:43:51.768672+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:53.421 INFO:teuthology.orchestra.run.smithi080.stdout:184683593754 2024-01-21T07:43:53.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:53 smithi080 bash[13909]: audit 2024-01-21T07:43:53.420016+0000 mon.a (mon.0) 504 : audit [DBG] from='client.? 172.21.15.80:0/2245927422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-21T07:43:53.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:53 smithi080 bash[17460]: audit 2024-01-21T07:43:53.420016+0000 mon.a (mon.0) 504 : audit [DBG] from='client.? 172.21.15.80:0/2245927422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-21T07:43:53.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:53 smithi195 bash[13978]: audit 2024-01-21T07:43:53.420016+0000 mon.a (mon.0) 504 : audit [DBG] from='client.? 172.21.15.80:0/2245927422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-21T07:43:54.136 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593749 got 184683593754 for osd.6 2024-01-21T07:43:54.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-01-21T07:43:55.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:54 smithi080 bash[13909]: cluster 2024-01-21T07:43:53.769426+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:55.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:54 smithi080 bash[17460]: cluster 2024-01-21T07:43:53.769426+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:55.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:54 smithi195 bash[13978]: cluster 2024-01-21T07:43:53.769426+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:55 smithi195 bash[13978]: cluster 2024-01-21T07:43:55.770002+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:56.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:55 smithi080 bash[13909]: cluster 2024-01-21T07:43:55.770002+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:56.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:55 smithi080 bash[17460]: cluster 2024-01-21T07:43:55.770002+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:56.972 INFO:teuthology.orchestra.run.smithi080.stdout:206158430230 2024-01-21T07:43:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:57 smithi080 bash[13909]: audit 2024-01-21T07:43:56.971335+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.80:0/3414928908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-21T07:43:57.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:57 smithi080 bash[17460]: audit 2024-01-21T07:43:56.971335+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.80:0/3414928908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-21T07:43:57.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:57 smithi195 bash[13978]: audit 2024-01-21T07:43:56.971335+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.80:0/3414928908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-21T07:43:57.657 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430225 got 206158430230 for osd.7 2024-01-21T07:43:57.657 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-01-21T07:43:57.658 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph pg dump --format=json 2024-01-21T07:43:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:58 smithi080 bash[13909]: cluster 2024-01-21T07:43:57.770393+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:58.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:58 smithi080 bash[17460]: cluster 2024-01-21T07:43:57.770393+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:43:58.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:58 smithi195 bash[13978]: cluster 2024-01-21T07:43:57.770393+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:00.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:43:59 smithi195 bash[13978]: cluster 2024-01-21T07:43:59.770975+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:00.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:43:59 smithi080 bash[13909]: cluster 2024-01-21T07:43:59.770975+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:00.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:43:59 smithi080 bash[17460]: cluster 2024-01-21T07:43:59.770975+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:00.349 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:44:00.351 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-01-21T07:44:00.637 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:00 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 7. 2024-01-21T07:44:00.638 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:00 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:44:00.638 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:00 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:44:00.638 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:00 smithi195 docker[23114]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:44:00.638 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:00 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:44:00.638 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:00 smithi195 bash[23133]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:44:01.028 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-01-21T07:43:59.770671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392344,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741568872,"statfs":{"total":767960285184,"available":759366524928,"internally_reserved":8589934592,"allocated":3760128,"data_stored":1503180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003461"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"49","state":"active+clean","last_fresh":"2024-01-21T07:42:17.783680+0000","last_change":"2024-01-21T07:42:17.783680+0000","last_active":"2024-01-21T07:42:17.783680+0000","last_peered":"2024-01-21T07:42:17.783680+0000","last_clean":"2024-01-21T07:42:17.783680+0000","last_became_active":"2024-01-21T07:42:17.778001+0000","last_became_peered":"2024-01-21T07:42:17.778001+0000","last_unstale":"2024-01-21T07:42:17.783680+0000","last_undegraded":"2024-01-21T07:42:17.783680+0000","last_fullsized":"2024-01-21T07:42:17.783680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T07:36:55.297568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T07:36:55.297568+0000","last_clean_scrub_stamp":"2024-01-21T07:36:55.297568+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430231,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.92600000000000005}]},{"osd":1,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.95499999999999996}]},{"osd":2,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.048}]},{"osd":3,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1}]},{"osd":5,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.103}]},{"osd":6,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.073}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049040,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696112,"statfs":{"total":95995035648,"available":94920818688,"internally_reserved":1073741824,"allocated":466944,"data_stored":187676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.95099999999999996}]},{"osd":1,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.099},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":1.119}]},{"osd":2,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.98399999999999999}]},{"osd":3,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0680000000000001}]},{"osd":4,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.1539999999999999}]},{"osd":5,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.876},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.0149999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.56100000000000005,"15min":0.52400000000000002},"min":{"1min":0.47999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.47999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84499999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jan 21 07:43:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Sun Jan 21 07:43:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.74199999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.875},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.996}]},{"osd":5,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.99399999999999999,"15min":0.98499999999999999},"min":{"1min":0.73199999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2809999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1879999999999999,"5min":1.341,"15min":1.341},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Jan 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0309999999999999}]},{"osd":7,"last update":"Sun Jan 21 07:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.137},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0860000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673018,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.626,"15min":0.59999999999999998},"min":{"1min":0.46899999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.995,"5min":1.099,"15min":1.099},"last":0.872},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.59799999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.90500000000000003}]},{"osd":2,"last update":"Sun Jan 21 07:43:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.52100000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.028,"5min":1.429,"15min":1.429},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.71399999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.0489999999999999}]},{"osd":3,"last update":"Sun Jan 21 07:43:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77600000000000002,"15min":0.76000000000000001},"min":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.113,"5min":1.149,"15min":1.149},"last":1.113},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.046,"5min":1.456,"15min":1.456},"last":0.81999999999999995}]},{"osd":4,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97499999999999998,"15min":0.96999999999999997},"min":{"1min":0.85499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.016,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.76700000000000002,"5min":0.75,"15min":0.75},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.0389999999999999}]},{"osd":5,"last update":"Sun Jan 21 07:43:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.014,"15min":1.0329999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2130000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.96399999999999997,"15min":0.97399999999999998},"min":{"1min":0.73499999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.163,"5min":1.635,"15min":1.635},"last":1.3360000000000001}]},{"osd":6,"last update":"Sun Jan 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.5800000000000001}]},{"osd":7,"last update":"Sun Jan 21 07:43:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.506},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.472}]}]},{"osd":2,"up_from":21,"seq":90194313264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049040,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696112,"statfs":{"total":95995035648,"available":94920818688,"internally_reserved":1073741824,"allocated":466944,"data_stored":187684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Jan 21 07:43:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.63300000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":1.103,"15min":1.103},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.90100000000000002}]},{"osd":3,"last update":"Sun Jan 21 07:43:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.54900000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90400000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.74199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0840000000000001,"5min":1.395,"15min":1.395},"last":0.876}]},{"osd":4,"last update":"Sun Jan 21 07:43:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.748,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93899999999999995,"15min":0.93100000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3009999999999999,"5min":1.304,"15min":1.304},"last":1.2050000000000001}]},{"osd":5,"last update":"Sun Jan 21 07:43:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4399999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.304},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.036},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.4910000000000001}]},{"osd":6,"last update":"Sun Jan 21 07:43:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.036},"min":{"1min":0.80400000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.4259999999999999,"5min":1.478,"15min":1.478},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.1000000000000001,"15min":1.1040000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3400000000000001,"5min":1.472,"15min":1.472},"last":1.5680000000000001}]},{"osd":7,"last update":"Sun Jan 21 07:43:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.444},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.409}]}]},{"osd":3,"up_from":27,"seq":115964117036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:45 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.745}]},{"osd":1,"last update":"Sun Jan 21 07:43:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.68600000000000005,"15min":0.65800000000000003},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Jan 21 07:43:45 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.75},"min":{"1min":0.52500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1990000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Jan 21 07:43:04 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90000000000000002,"15min":0.89300000000000002},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.78300000000000003}]},{"osd":5,"last update":"Sun Jan 21 07:43:29 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95399999999999996,"15min":0.95599999999999996},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.042,"15min":1.052},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.304,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Jan 21 07:43:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.056,"15min":1.054},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3169999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.042}]},{"osd":7,"last update":"Sun Jan 21 07:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.0209999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.087,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79700000000000004,"15min":0.78200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.89400000000000002}]},{"osd":1,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.81599999999999995,"15min":0.80000000000000004},"min":{"1min":0.65400000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.70299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.056},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92200000000000004,"15min":0.91400000000000003},"min":{"1min":0.754,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.98399999999999999}]},{"osd":3,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.90100000000000002,"15min":0.89100000000000001},"min":{"1min":0.73199999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.026}]},{"osd":5,"last update":"Sun Jan 21 07:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.79100000000000004,"15min":0.77600000000000002},"min":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.623},{"interface":"front","average":{"1min":1.097,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.0669999999999999}]},{"osd":6,"last update":"Sun Jan 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.006}]},{"osd":7,"last update":"Sun Jan 21 07:43:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.133},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.0920000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.86399999999999999}]},{"osd":1,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.84799999999999998,"15min":0.84399999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.1779999999999999}]},{"osd":2,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85699999999999998,"15min":0.84999999999999998},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.222,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.88200000000000001,"15min":0.875},"min":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94999999999999996,"15min":0.93899999999999995},"min":{"1min":0.81299999999999994,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.117}]},{"osd":4,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.04},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1870000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.24}]},{"osd":6,"last update":"Sun Jan 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.0209999999999999}]},{"osd":7,"last update":"Sun Jan 21 07:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.1439999999999999}]}]}]}} 2024-01-21T07:44:01.030 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph pg dump --format=json 2024-01-21T07:44:01.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:00 smithi195 bash[13978]: audit 2024-01-21T07:44:00.344324+0000 mgr.y (mgr.14140) 278 : audit [DBG] from='client.24496 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:44:01.169 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:00 smithi080 bash[13909]: audit 2024-01-21T07:44:00.344324+0000 mgr.y (mgr.14140) 278 : audit [DBG] from='client.24496 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:44:01.170 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:00 smithi080 bash[17460]: audit 2024-01-21T07:44:00.344324+0000 mgr.y (mgr.14140) 278 : audit [DBG] from='client.24496 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:44:02.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:01 smithi080 bash[13909]: cluster 2024-01-21T07:44:01.771666+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:02.106 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:01 smithi080 bash[17460]: cluster 2024-01-21T07:44:01.771666+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:02.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:01 smithi195 bash[13978]: cluster 2024-01-21T07:44:01.771666+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:03.776 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:44:03.777 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-01-21T07:44:03.887 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:03 smithi195 bash[23133]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:03.887 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:03 smithi195 bash[23133]: See 'docker run --help'. 2024-01-21T07:44:03.888 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:03 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:44:03.888 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:03 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:44:04.433 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-01-21T07:44:01.771337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392344,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741568872,"statfs":{"total":767960285184,"available":759366524928,"internally_reserved":8589934592,"allocated":3760128,"data_stored":1503180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003497"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"49","state":"active+clean","last_fresh":"2024-01-21T07:42:17.783680+0000","last_change":"2024-01-21T07:42:17.783680+0000","last_active":"2024-01-21T07:42:17.783680+0000","last_peered":"2024-01-21T07:42:17.783680+0000","last_clean":"2024-01-21T07:42:17.783680+0000","last_became_active":"2024-01-21T07:42:17.778001+0000","last_became_peered":"2024-01-21T07:42:17.778001+0000","last_unstale":"2024-01-21T07:42:17.783680+0000","last_undegraded":"2024-01-21T07:42:17.783680+0000","last_fullsized":"2024-01-21T07:42:17.783680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T07:36:55.297568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T07:36:55.297568+0000","last_clean_scrub_stamp":"2024-01-21T07:36:55.297568+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430231,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.92600000000000005}]},{"osd":1,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.95499999999999996}]},{"osd":2,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.048}]},{"osd":3,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1}]},{"osd":5,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.103}]},{"osd":6,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.073}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049040,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696112,"statfs":{"total":95995035648,"available":94920818688,"internally_reserved":1073741824,"allocated":466944,"data_stored":187676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.95099999999999996}]},{"osd":1,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.099},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":1.119}]},{"osd":2,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.98399999999999999}]},{"osd":3,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0680000000000001}]},{"osd":4,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.1539999999999999}]},{"osd":5,"last update":"Sun Jan 21 07:42:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.876},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.0149999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.59699999999999998,"15min":0.53600000000000003},"min":{"1min":0.46899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67500000000000004,"15min":0.60999999999999999},"min":{"1min":0.46600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.119}]},{"osd":2,"last update":"Sun Jan 21 07:43:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84499999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Jan 21 07:43:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Sun Jan 21 07:43:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.74199999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.089},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.99399999999999999,"15min":0.98499999999999999},"min":{"1min":0.73199999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2809999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.214},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1879999999999999,"5min":1.341,"15min":1.341},"last":1.167}]},{"osd":6,"last update":"Sun Jan 21 07:43:57 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.018,"15min":1.0069999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.085,"15min":1.083},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3140000000000001,"5min":1.399,"15min":1.399},"last":1.276}]},{"osd":7,"last update":"Sun Jan 21 07:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.149}]}]},{"osd":0,"up_from":10,"seq":42949673019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 07:43:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64700000000000002,"15min":0.60699999999999998},"min":{"1min":0.49399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95599999999999996,"5min":1.099,"15min":1.099},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.70299999999999996,"15min":0.65700000000000003},"min":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.101,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Sun Jan 21 07:43:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.52100000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.028,"5min":1.429,"15min":1.429},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.71399999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.88100000000000001}]},{"osd":3,"last update":"Sun Jan 21 07:43:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77600000000000002,"15min":0.76000000000000001},"min":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.113,"5min":1.149,"15min":1.149},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.046,"5min":1.456,"15min":1.456},"last":0.59899999999999998}]},{"osd":4,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97499999999999998,"15min":0.96999999999999997},"min":{"1min":0.85499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.016,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.76700000000000002,"5min":0.75,"15min":0.75},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.0649999999999999}]},{"osd":5,"last update":"Sun Jan 21 07:43:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.014,"15min":1.0329999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2130000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.871},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.96399999999999997,"15min":0.97399999999999998},"min":{"1min":0.73499999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.163,"5min":1.635,"15min":1.635},"last":1.0069999999999999}]},{"osd":6,"last update":"Sun Jan 21 07:43:56 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.089,"15min":1.0900000000000001},"min":{"1min":0.86899999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5629999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.101},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.1100000000000001},"min":{"1min":0.871,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5800000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Sun Jan 21 07:43:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.0309999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049040,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696112,"statfs":{"total":95995035648,"available":94920818688,"internally_reserved":1073741824,"allocated":466944,"data_stored":187684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Jan 21 07:43:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.63300000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":1.103,"15min":1.103},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.90100000000000002}]},{"osd":3,"last update":"Sun Jan 21 07:43:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.54900000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90400000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.74199999999999999},"min":{"1min":0.58299999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0840000000000001,"5min":1.395,"15min":1.395},"last":0.876}]},{"osd":4,"last update":"Sun Jan 21 07:43:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.748,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93899999999999995,"15min":0.93100000000000005},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3009999999999999,"5min":1.304,"15min":1.304},"last":1.2050000000000001}]},{"osd":5,"last update":"Sun Jan 21 07:43:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4399999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.304},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.036},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.4910000000000001}]},{"osd":6,"last update":"Sun Jan 21 07:43:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.036},"min":{"1min":0.80400000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.4259999999999999,"5min":1.478,"15min":1.478},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.1000000000000001,"15min":1.1040000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3400000000000001,"5min":1.472,"15min":1.472},"last":1.5680000000000001}]},{"osd":7,"last update":"Sun Jan 21 07:43:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.444},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.409}]}]},{"osd":3,"up_from":27,"seq":115964117036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:45 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.745}]},{"osd":1,"last update":"Sun Jan 21 07:43:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.68600000000000005,"15min":0.65800000000000003},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Jan 21 07:43:45 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.75},"min":{"1min":0.52500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1990000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Jan 21 07:43:04 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90000000000000002,"15min":0.89300000000000002},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.78300000000000003}]},{"osd":5,"last update":"Sun Jan 21 07:43:29 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.95399999999999996,"15min":0.95599999999999996},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.042,"15min":1.052},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.304,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Jan 21 07:43:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.056,"15min":1.054},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3169999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.042}]},{"osd":7,"last update":"Sun Jan 21 07:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.0209999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.087,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79700000000000004,"15min":0.78200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.89400000000000002}]},{"osd":1,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.81599999999999995,"15min":0.80000000000000004},"min":{"1min":0.65400000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.70299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.056},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92200000000000004,"15min":0.91400000000000003},"min":{"1min":0.754,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.98399999999999999}]},{"osd":3,"last update":"Sun Jan 21 07:43:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.90100000000000002,"15min":0.89100000000000001},"min":{"1min":0.73199999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.026}]},{"osd":5,"last update":"Sun Jan 21 07:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.79100000000000004,"15min":0.77600000000000002},"min":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.623},{"interface":"front","average":{"1min":1.097,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.0669999999999999}]},{"osd":6,"last update":"Sun Jan 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.006}]},{"osd":7,"last update":"Sun Jan 21 07:43:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.133},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.0920000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049044,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696108,"statfs":{"total":95995035648,"available":94920814592,"internally_reserved":1073741824,"allocated":471040,"data_stored":187970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.84799999999999998,"15min":0.84399999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.88300000000000001}]},{"osd":2,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85699999999999998,"15min":0.84999999999999998},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.222,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.88200000000000001,"15min":0.875},"min":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.90400000000000003}]},{"osd":3,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94999999999999996,"15min":0.93899999999999995},"min":{"1min":0.81299999999999994,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0289999999999999}]},{"osd":4,"last update":"Sun Jan 21 07:43:25 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1870000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Jan 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.0980000000000001}]},{"osd":7,"last update":"Sun Jan 21 07:43:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.01}]}]}]}} 2024-01-21T07:44:04.435 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-01-21T07:44:04.435 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-21T07:44:04.435 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-01-21T07:44:04.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -- ceph health --format=json 2024-01-21T07:44:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:04 smithi080 bash[13909]: audit 2024-01-21T07:44:03.768727+0000 mgr.y (mgr.14140) 280 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:44:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:04 smithi080 bash[13909]: cluster 2024-01-21T07:44:03.773356+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:05.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:04 smithi080 bash[17460]: audit 2024-01-21T07:44:03.768727+0000 mgr.y (mgr.14140) 280 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:44:05.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:04 smithi080 bash[17460]: cluster 2024-01-21T07:44:03.773356+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:04 smithi195 bash[13978]: audit 2024-01-21T07:44:03.768727+0000 mgr.y (mgr.14140) 280 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-21T07:44:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:04 smithi195 bash[13978]: cluster 2024-01-21T07:44:03.773356+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:05 smithi080 bash[13909]: cluster 2024-01-21T07:44:05.773940+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:06.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:05 smithi080 bash[17460]: cluster 2024-01-21T07:44:05.773940+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:05 smithi195 bash[13978]: cluster 2024-01-21T07:44:05.773940+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:07.294 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-01-21T07:44:07.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:07 smithi195 bash[13978]: audit 2024-01-21T07:44:07.292635+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.80:0/1692781648' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-21T07:44:07.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:07 smithi080 bash[13909]: audit 2024-01-21T07:44:07.292635+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.80:0/1692781648' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-21T07:44:07.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:07 smithi080 bash[17460]: audit 2024-01-21T07:44:07.292635+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.80:0/1692781648' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-21T07:44:08.037 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-21T07:44:08.037 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-01-21T07:44:08.038 INFO:tasks.cephadm:Setup complete, yielding 2024-01-21T07:44:08.038 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-21T07:44:08.048 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-01-21T07:44:08.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-01-21T07:44:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:08 smithi080 bash[13909]: cluster 2024-01-21T07:44:07.774509+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:08.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:08 smithi080 bash[17460]: cluster 2024-01-21T07:44:07.774509+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:08.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:08 smithi195 bash[13978]: cluster 2024-01-21T07:44:07.774509+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:10.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:09 smithi080 bash[13909]: cluster 2024-01-21T07:44:09.775089+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:09 smithi080 bash[17460]: cluster 2024-01-21T07:44:09.775089+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:10.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:09 smithi195 bash[13978]: cluster 2024-01-21T07:44:09.775089+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:12.239 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:44:12.239 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "a8c10dda-cfed-408b-9d93-e2690f68c712", 2024-01-21T07:44:12.239 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "r", 2024-01-21T07:44:12.239 INFO:teuthology.orchestra.run.smithi080.stdout: "current_period": "66a97ab2-2d4c-4ffc-92f3-7aa2fdeae9be", 2024-01-21T07:44:12.239 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 1 2024-01-21T07:44:12.239 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:44:12.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:12 smithi080 bash[13909]: cluster 2024-01-21T07:44:11.195025+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-01-21T07:44:12.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:12 smithi080 bash[13909]: audit 2024-01-21T07:44:11.201306+0000 mon.a (mon.0) 506 : audit [INF] from='client.? 172.21.15.80:0/4255693590' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-01-21T07:44:12.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:12 smithi080 bash[13909]: cluster 2024-01-21T07:44:11.775689+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v244: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:12.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:12 smithi080 bash[17460]: cluster 2024-01-21T07:44:11.195025+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-01-21T07:44:12.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:12 smithi080 bash[17460]: audit 2024-01-21T07:44:11.201306+0000 mon.a (mon.0) 506 : audit [INF] from='client.? 172.21.15.80:0/4255693590' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-01-21T07:44:12.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:12 smithi080 bash[17460]: cluster 2024-01-21T07:44:11.775689+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v244: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:12.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:12 smithi195 bash[13978]: cluster 2024-01-21T07:44:11.195025+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-01-21T07:44:12.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:12 smithi195 bash[13978]: audit 2024-01-21T07:44:11.201306+0000 mon.a (mon.0) 506 : audit [INF] from='client.? 172.21.15.80:0/4255693590' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-01-21T07:44:12.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:12 smithi195 bash[13978]: cluster 2024-01-21T07:44:11.775689+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v244: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:44:12.984 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-01-21T07:44:13.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:13 smithi080 bash[13909]: audit 2024-01-21T07:44:12.198966+0000 mon.a (mon.0) 507 : audit [INF] from='client.? 172.21.15.80:0/4255693590' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-01-21T07:44:13.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:13 smithi080 bash[13909]: cluster 2024-01-21T07:44:12.199184+0000 mon.a (mon.0) 508 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-01-21T07:44:13.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:13 smithi080 bash[17460]: audit 2024-01-21T07:44:12.198966+0000 mon.a (mon.0) 507 : audit [INF] from='client.? 172.21.15.80:0/4255693590' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-01-21T07:44:13.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:13 smithi080 bash[17460]: cluster 2024-01-21T07:44:12.199184+0000 mon.a (mon.0) 508 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-01-21T07:44:13.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:13 smithi195 bash[13978]: audit 2024-01-21T07:44:12.198966+0000 mon.a (mon.0) 507 : audit [INF] from='client.? 172.21.15.80:0/4255693590' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-01-21T07:44:13.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:13 smithi195 bash[13978]: cluster 2024-01-21T07:44:12.199184+0000 mon.a (mon.0) 508 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-01-21T07:44:14.236 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:13 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 8. 2024-01-21T07:44:14.237 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:13 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:44:14.237 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:13 smithi195 systemd[1]: Starting Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:44:14.237 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:13 smithi195 docker[23145]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-node-exporter.b 2024-01-21T07:44:14.237 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:13 smithi195 systemd[1]: Started Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:44:14.237 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:13 smithi195 bash[23168]: Unable to find image 'prom/node-exporter:latest' locally 2024-01-21T07:44:14.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:14 smithi080 bash[13909]: cluster 2024-01-21T07:44:13.219252+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-01-21T07:44:14.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:14 smithi080 bash[13909]: cluster 2024-01-21T07:44:13.776357+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v247: 33 pgs: 14 active+clean, 5 creating+peering, 14 unknown; 10 B data, 3.7 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-01-21T07:44:14.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:14 smithi080 bash[17460]: cluster 2024-01-21T07:44:13.219252+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-01-21T07:44:14.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:14 smithi080 bash[17460]: cluster 2024-01-21T07:44:13.776357+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v247: 33 pgs: 14 active+clean, 5 creating+peering, 14 unknown; 10 B data, 3.7 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-01-21T07:44:14.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:14 smithi195 bash[13978]: cluster 2024-01-21T07:44:13.219252+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-01-21T07:44:14.637 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:14 smithi195 bash[13978]: cluster 2024-01-21T07:44:13.776357+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v247: 33 pgs: 14 active+clean, 5 creating+peering, 14 unknown; 10 B data, 3.7 MiB used, 707 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-01-21T07:44:15.576 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "7f38bfe9-a39a-4b06-89fa-bffb3878088f", 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default", 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "api_name": "default", 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "is_master": "true", 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "endpoints": [], 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "hostnames": [], 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "hostnames_s3website": [], 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "master_zone": "", 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "zones": [], 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "placement_targets": [], 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "default_placement": "", 2024-01-21T07:44:15.577 INFO:teuthology.orchestra.run.smithi080.stdout: "realm_id": "a8c10dda-cfed-408b-9d93-e2690f68c712", 2024-01-21T07:44:15.578 INFO:teuthology.orchestra.run.smithi080.stdout: "sync_policy": { 2024-01-21T07:44:15.578 INFO:teuthology.orchestra.run.smithi080.stdout: "groups": [] 2024-01-21T07:44:15.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:15.578 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:44:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:15 smithi080 bash[13909]: cluster 2024-01-21T07:44:15.777049+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v248: 33 pgs: 22 active+clean, 5 creating+peering, 6 unknown; 400 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2024-01-21T07:44:16.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:15 smithi080 bash[17460]: cluster 2024-01-21T07:44:15.777049+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v248: 33 pgs: 22 active+clean, 5 creating+peering, 6 unknown; 400 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2024-01-21T07:44:16.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:15 smithi195 bash[13978]: cluster 2024-01-21T07:44:15.777049+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v248: 33 pgs: 22 active+clean, 5 creating+peering, 6 unknown; 400 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2024-01-21T07:44:16.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-01-21T07:44:17.843 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:17 smithi195 bash[23168]: docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:17.843 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:17 smithi195 bash[23168]: See 'docker run --help'. 2024-01-21T07:44:17.843 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:17 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=125/n/a 2024-01-21T07:44:17.843 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:17 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:44:18.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:17 smithi195 bash[13978]: cluster 2024-01-21T07:44:17.777810+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v249: 33 pgs: 33 active+clean; 726 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s 2024-01-21T07:44:18.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:17 smithi080 bash[13909]: cluster 2024-01-21T07:44:17.777810+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v249: 33 pgs: 33 active+clean; 726 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s 2024-01-21T07:44:18.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:17 smithi080 bash[17460]: cluster 2024-01-21T07:44:17.777810+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v249: 33 pgs: 33 active+clean; 726 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s wr, 1 op/s 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "95f61e06-50d1-4c1c-a92d-aa19cf6ac6bd", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "z", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "domain_root": "z.rgw.meta:root", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "control_pool": "z.rgw.control", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "gc_pool": "z.rgw.log:gc", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "lc_pool": "z.rgw.log:lc", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "log_pool": "z.rgw.log", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "roles_pool": "z.rgw.meta:roles", 2024-01-21T07:44:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "otp_pool": "z.rgw.otp", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "system_key": { 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "access_key": "", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "secret_key": "" 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "placement_pools": [ 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "default-placement", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "val": { 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "index_pool": "z.rgw.buckets.index", 2024-01-21T07:44:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_classes": { 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "STANDARD": { 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "data_pool": "z.rgw.buckets.data" 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "index_type": 0 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "realm_id": "a8c10dda-cfed-408b-9d93-e2690f68c712" 2024-01-21T07:44:18.856 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:44:19.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-01-21T07:44:20.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:19 smithi080 bash[13909]: cluster 2024-01-21T07:44:19.778426+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v250: 33 pgs: 33 active+clean; 772 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 127 B/s rd, 1.4 KiB/s wr, 1 op/s 2024-01-21T07:44:20.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:19 smithi080 bash[17460]: cluster 2024-01-21T07:44:19.778426+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v250: 33 pgs: 33 active+clean; 772 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 127 B/s rd, 1.4 KiB/s wr, 1 op/s 2024-01-21T07:44:20.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:19 smithi195 bash[13978]: cluster 2024-01-21T07:44:19.778426+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v250: 33 pgs: 33 active+clean; 772 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 127 B/s rd, 1.4 KiB/s wr, 1 op/s 2024-01-21T07:44:22.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:21 smithi195 bash[13978]: cluster 2024-01-21T07:44:21.779149+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v251: 33 pgs: 33 active+clean; 1.0 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 427 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-01-21T07:44:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:21 smithi080 bash[13909]: cluster 2024-01-21T07:44:21.779149+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v251: 33 pgs: 33 active+clean; 1.0 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 427 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-01-21T07:44:22.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:21 smithi080 bash[17460]: cluster 2024-01-21T07:44:21.779149+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v251: 33 pgs: 33 active+clean; 1.0 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 427 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-01-21T07:44:24.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:23 smithi195 bash[13978]: cluster 2024-01-21T07:44:22.856990+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-01-21T07:44:24.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:23 smithi195 bash[13978]: audit 2024-01-21T07:44:22.858921+0000 mon.a (mon.0) 511 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-01-21T07:44:24.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:23 smithi195 bash[13978]: cluster 2024-01-21T07:44:23.779687+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v253: 65 pgs: 32 unknown, 33 active+clean; 1.8 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 818 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-01-21T07:44:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:23 smithi080 bash[13909]: cluster 2024-01-21T07:44:22.856990+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-01-21T07:44:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:23 smithi080 bash[13909]: audit 2024-01-21T07:44:22.858921+0000 mon.a (mon.0) 511 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-01-21T07:44:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:23 smithi080 bash[13909]: cluster 2024-01-21T07:44:23.779687+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v253: 65 pgs: 32 unknown, 33 active+clean; 1.8 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 818 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-01-21T07:44:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:23 smithi080 bash[17460]: cluster 2024-01-21T07:44:22.856990+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-01-21T07:44:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:23 smithi080 bash[17460]: audit 2024-01-21T07:44:22.858921+0000 mon.a (mon.0) 511 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-01-21T07:44:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:23 smithi080 bash[17460]: cluster 2024-01-21T07:44:23.779687+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v253: 65 pgs: 32 unknown, 33 active+clean; 1.8 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 818 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-01-21T07:44:25.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:24 smithi195 bash[13978]: audit 2024-01-21T07:44:23.858459+0000 mon.a (mon.0) 512 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-01-21T07:44:25.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:24 smithi195 bash[13978]: cluster 2024-01-21T07:44:23.858756+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-01-21T07:44:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:24 smithi080 bash[13909]: audit 2024-01-21T07:44:23.858459+0000 mon.a (mon.0) 512 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-01-21T07:44:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:24 smithi080 bash[13909]: cluster 2024-01-21T07:44:23.858756+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-01-21T07:44:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:24 smithi080 bash[17460]: audit 2024-01-21T07:44:23.858459+0000 mon.a (mon.0) 512 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-01-21T07:44:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:24 smithi080 bash[17460]: cluster 2024-01-21T07:44:23.858756+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-01-21T07:44:26.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[17460]: cluster 2024-01-21T07:44:24.876324+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-01-21T07:44:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[17460]: audit 2024-01-21T07:44:24.880389+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-01-21T07:44:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[17460]: cluster 2024-01-21T07:44:25.780310+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v256: 97 pgs: 4 creating+peering, 49 unknown, 44 active+clean; 1.8 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 3 op/s 2024-01-21T07:44:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[17460]: audit 2024-01-21T07:44:25.878435+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-01-21T07:44:26.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[17460]: cluster 2024-01-21T07:44:25.879217+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-01-21T07:44:26.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[13909]: cluster 2024-01-21T07:44:24.876324+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-01-21T07:44:26.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[13909]: audit 2024-01-21T07:44:24.880389+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-01-21T07:44:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[13909]: cluster 2024-01-21T07:44:25.780310+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v256: 97 pgs: 4 creating+peering, 49 unknown, 44 active+clean; 1.8 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 3 op/s 2024-01-21T07:44:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[13909]: audit 2024-01-21T07:44:25.878435+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-01-21T07:44:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:25 smithi080 bash[13909]: cluster 2024-01-21T07:44:25.879217+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-01-21T07:44:26.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:25 smithi195 bash[13978]: cluster 2024-01-21T07:44:24.876324+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-01-21T07:44:26.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:25 smithi195 bash[13978]: audit 2024-01-21T07:44:24.880389+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-01-21T07:44:26.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:25 smithi195 bash[13978]: cluster 2024-01-21T07:44:25.780310+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v256: 97 pgs: 4 creating+peering, 49 unknown, 44 active+clean; 1.8 KiB data, 4.1 MiB used, 707 GiB / 715 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 3 op/s 2024-01-21T07:44:26.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:25 smithi195 bash[13978]: audit 2024-01-21T07:44:25.878435+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.80:0/3898004085' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-01-21T07:44:26.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:25 smithi195 bash[13978]: cluster 2024-01-21T07:44:25.879217+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-01-21T07:44:27.922 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:27 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Scheduled restart job, restart counter is at 9. 2024-01-21T07:44:27.923 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:27 smithi195 systemd[1]: Stopped Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:44:27.923 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:27 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Start request repeated too quickly. 2024-01-21T07:44:27.923 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:27 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-21T07:44:27.923 INFO:journalctl@ceph.node-exporter.b.smithi195.stdout:Jan 21 07:44:27 smithi195 systemd[1]: Failed to start Ceph node-exporter.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:44:27.923 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:27 smithi195 bash[13978]: cluster 2024-01-21T07:44:26.901785+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-01-21T07:44:27.923 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:27 smithi195 bash[13978]: audit 2024-01-21T07:44:26.904634+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-01-21T07:44:27.923 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:27 smithi195 bash[13978]: audit 2024-01-21T07:44:26.906141+0000 mon.a (mon.0) 519 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-01-21T07:44:27.923 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:27 smithi195 bash[13978]: cluster 2024-01-21T07:44:27.781214+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v259: 129 pgs: 22 creating+peering, 35 unknown, 72 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2024-01-21T07:44:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[13909]: cluster 2024-01-21T07:44:26.901785+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-01-21T07:44:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[13909]: audit 2024-01-21T07:44:26.904634+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-01-21T07:44:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[13909]: audit 2024-01-21T07:44:26.906141+0000 mon.a (mon.0) 519 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-01-21T07:44:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[13909]: cluster 2024-01-21T07:44:27.781214+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v259: 129 pgs: 22 creating+peering, 35 unknown, 72 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2024-01-21T07:44:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[17460]: cluster 2024-01-21T07:44:26.901785+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-01-21T07:44:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[17460]: audit 2024-01-21T07:44:26.904634+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-01-21T07:44:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[17460]: audit 2024-01-21T07:44:26.906141+0000 mon.a (mon.0) 519 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-01-21T07:44:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:27 smithi080 bash[17460]: cluster 2024-01-21T07:44:27.781214+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v259: 129 pgs: 22 creating+peering, 35 unknown, 72 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2024-01-21T07:44:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[13909]: audit 2024-01-21T07:44:27.905250+0000 mon.a (mon.0) 520 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-01-21T07:44:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[13909]: cluster 2024-01-21T07:44:27.905766+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-01-21T07:44:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[13909]: audit 2024-01-21T07:44:27.910813+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-01-21T07:44:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[13909]: audit 2024-01-21T07:44:27.918898+0000 mon.a (mon.0) 522 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-01-21T07:44:29.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[17460]: audit 2024-01-21T07:44:27.905250+0000 mon.a (mon.0) 520 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-01-21T07:44:29.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[17460]: cluster 2024-01-21T07:44:27.905766+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-01-21T07:44:29.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[17460]: audit 2024-01-21T07:44:27.910813+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-01-21T07:44:29.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:28 smithi080 bash[17460]: audit 2024-01-21T07:44:27.918898+0000 mon.a (mon.0) 522 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-01-21T07:44:29.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:28 smithi195 bash[13978]: audit 2024-01-21T07:44:27.905250+0000 mon.a (mon.0) 520 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-01-21T07:44:29.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:28 smithi195 bash[13978]: cluster 2024-01-21T07:44:27.905766+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-01-21T07:44:29.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:28 smithi195 bash[13978]: audit 2024-01-21T07:44:27.910813+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-01-21T07:44:29.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:28 smithi195 bash[13978]: audit 2024-01-21T07:44:27.918898+0000 mon.a (mon.0) 522 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-01-21T07:44:30.137 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:44:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "d136e2c9-5a13-46ca-8741-c69269706b27", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 1, 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "predecessor_uuid": "66a97ab2-2d4c-4ffc-92f3-7aa2fdeae9be", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "sync_status": [], 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "period_map": { 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "d136e2c9-5a13-46ca-8741-c69269706b27", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "zonegroups": [ 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "7f38bfe9-a39a-4b06-89fa-bffb3878088f", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "api_name": "default", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "is_master": "true", 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "endpoints": [], 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "hostnames": [], 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "hostnames_s3website": [], 2024-01-21T07:44:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "master_zone": "95f61e06-50d1-4c1c-a92d-aa19cf6ac6bd", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "zones": [ 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "id": "95f61e06-50d1-4c1c-a92d-aa19cf6ac6bd", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "z", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "endpoints": [], 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "log_meta": "false", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "log_data": "false", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "bucket_index_max_shards": 11, 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "read_only": "false", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_type": "", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "sync_from_all": "true", 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "sync_from": [], 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_zone": "" 2024-01-21T07:44:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "placement_targets": [ 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default-placement", 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_classes": [ 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "STANDARD" 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_placement": "default-placement", 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "realm_id": "a8c10dda-cfed-408b-9d93-e2690f68c712", 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "sync_policy": { 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "groups": [] 2024-01-21T07:44:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "short_zone_ids": [ 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "95f61e06-50d1-4c1c-a92d-aa19cf6ac6bd", 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 1069638591 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "master_zonegroup": "7f38bfe9-a39a-4b06-89fa-bffb3878088f", 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "master_zone": "95f61e06-50d1-4c1c-a92d-aa19cf6ac6bd", 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "period_config": { 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "bucket_quota": { 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": false, 2024-01-21T07:44:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "check_on_raw": false, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max_size": -1, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max_size_kb": 0, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max_objects": -1 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "user_quota": { 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": false, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "check_on_raw": false, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max_size": -1, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max_size_kb": 0, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max_objects": -1 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "realm_id": "a8c10dda-cfed-408b-9d93-e2690f68c712", 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "realm_name": "r", 2024-01-21T07:44:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "realm_epoch": 2 2024-01-21T07:44:30.143 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:44:30.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[13909]: audit 2024-01-21T07:44:28.928867+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-01-21T07:44:30.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[13909]: cluster 2024-01-21T07:44:28.929012+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-01-21T07:44:30.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[13909]: audit 2024-01-21T07:44:28.930888+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-01-21T07:44:30.190 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[13909]: audit 2024-01-21T07:44:28.931281+0000 mon.a (mon.0) 525 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-01-21T07:44:30.191 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[13909]: cluster 2024-01-21T07:44:29.781860+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v262: 129 pgs: 18 creating+peering, 22 unknown, 89 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-01-21T07:44:30.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[17460]: audit 2024-01-21T07:44:28.928867+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-01-21T07:44:30.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[17460]: cluster 2024-01-21T07:44:28.929012+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-01-21T07:44:30.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[17460]: audit 2024-01-21T07:44:28.930888+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-01-21T07:44:30.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[17460]: audit 2024-01-21T07:44:28.931281+0000 mon.a (mon.0) 525 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-01-21T07:44:30.191 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:29 smithi080 bash[17460]: cluster 2024-01-21T07:44:29.781860+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v262: 129 pgs: 18 creating+peering, 22 unknown, 89 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-01-21T07:44:30.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:29 smithi195 bash[13978]: audit 2024-01-21T07:44:28.928867+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-01-21T07:44:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:29 smithi195 bash[13978]: cluster 2024-01-21T07:44:28.929012+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-01-21T07:44:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:29 smithi195 bash[13978]: audit 2024-01-21T07:44:28.930888+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.80:0/4035842447' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-01-21T07:44:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:29 smithi195 bash[13978]: audit 2024-01-21T07:44:28.931281+0000 mon.a (mon.0) 525 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-01-21T07:44:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:29 smithi195 bash[13978]: cluster 2024-01-21T07:44:29.781860+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v262: 129 pgs: 18 creating+peering, 22 unknown, 89 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-01-21T07:44:30.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph orch apply rgw r z --placement=2 --port=8000' 2024-01-21T07:44:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:30 smithi080 bash[13909]: audit 2024-01-21T07:44:29.946114+0000 mon.a (mon.0) 526 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-01-21T07:44:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:30 smithi080 bash[13909]: cluster 2024-01-21T07:44:29.946183+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-01-21T07:44:31.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:30 smithi080 bash[17460]: audit 2024-01-21T07:44:29.946114+0000 mon.a (mon.0) 526 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-01-21T07:44:31.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:30 smithi080 bash[17460]: cluster 2024-01-21T07:44:29.946183+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-01-21T07:44:31.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:30 smithi195 bash[13978]: audit 2024-01-21T07:44:29.946114+0000 mon.a (mon.0) 526 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-01-21T07:44:31.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:30 smithi195 bash[13978]: cluster 2024-01-21T07:44:29.946183+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-01-21T07:44:32.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:31 smithi080 bash[13909]: cluster 2024-01-21T07:44:31.782834+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v264: 129 pgs: 13 creating+peering, 3 unknown, 113 active+clean; 3.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 628 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-01-21T07:44:32.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:31 smithi080 bash[17460]: cluster 2024-01-21T07:44:31.782834+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v264: 129 pgs: 13 creating+peering, 3 unknown, 113 active+clean; 3.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 628 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-01-21T07:44:32.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:31 smithi195 bash[13978]: cluster 2024-01-21T07:44:31.782834+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v264: 129 pgs: 13 creating+peering, 3 unknown, 113 active+clean; 3.3 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 628 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-01-21T07:44:33.767 INFO:teuthology.orchestra.run.smithi080.stdout:Scheduled rgw update... 2024-01-21T07:44:34.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:33 smithi195 bash[13978]: audit 2024-01-21T07:44:33.751182+0000 mgr.y (mgr.14140) 296 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:44:34.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:33 smithi195 bash[13978]: cephadm 2024-01-21T07:44:33.752292+0000 mgr.y (mgr.14140) 297 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-01-21T07:44:34.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:33 smithi195 bash[13978]: audit 2024-01-21T07:44:33.753101+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-01-21T07:44:33.752330\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-01-21T07:44:34.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:33 smithi195 bash[13978]: audit 2024-01-21T07:44:33.756712+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-01-21T07:44:33.752330\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-01-21T07:44:34.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:33 smithi195 bash[13978]: cephadm 2024-01-21T07:44:33.765559+0000 mgr.y (mgr.14140) 298 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:34.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:33 smithi195 bash[13978]: cluster 2024-01-21T07:44:33.783572+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 5.5 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 4.0 KiB/s wr, 14 op/s 2024-01-21T07:44:34.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[13909]: audit 2024-01-21T07:44:33.751182+0000 mgr.y (mgr.14140) 296 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:44:34.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[13909]: cephadm 2024-01-21T07:44:33.752292+0000 mgr.y (mgr.14140) 297 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-01-21T07:44:34.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[13909]: audit 2024-01-21T07:44:33.753101+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-01-21T07:44:33.752330\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[13909]: audit 2024-01-21T07:44:33.756712+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-01-21T07:44:33.752330\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[13909]: cephadm 2024-01-21T07:44:33.765559+0000 mgr.y (mgr.14140) 298 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[13909]: cluster 2024-01-21T07:44:33.783572+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 5.5 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 4.0 KiB/s wr, 14 op/s 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[17460]: audit 2024-01-21T07:44:33.751182+0000 mgr.y (mgr.14140) 296 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[17460]: cephadm 2024-01-21T07:44:33.752292+0000 mgr.y (mgr.14140) 297 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[17460]: audit 2024-01-21T07:44:33.753101+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-01-21T07:44:33.752330\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[17460]: audit 2024-01-21T07:44:33.756712+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-01-21T07:44:33.752330\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[17460]: cephadm 2024-01-21T07:44:33.765559+0000 mgr.y (mgr.14140) 298 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:34.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:33 smithi080 bash[17460]: cluster 2024-01-21T07:44:33.783572+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 5.5 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 4.0 KiB/s wr, 14 op/s 2024-01-21T07:44:34.492 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'sleep 120' 2024-01-21T07:44:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:35 smithi080 bash[13909]: cluster 2024-01-21T07:44:35.784571+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 909 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-01-21T07:44:36.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:35 smithi080 bash[17460]: cluster 2024-01-21T07:44:35.784571+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 909 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-01-21T07:44:36.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:35 smithi195 bash[13978]: cluster 2024-01-21T07:44:35.784571+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 909 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: debug 2024-01-21T07:44:37.541+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:37.809 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:37.810 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:37.811 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: cephadm 2024-01-21T07:44:37.544427+0000 mgr.y (mgr.14140) 301 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: cephadm 2024-01-21T07:44:37.544735+0000 mgr.y (mgr.14140) 302 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:38.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:38.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:37 smithi195 bash[13978]: cephadm 2024-01-21T07:44:37.552128+0000 mgr.y (mgr.14140) 303 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: cephadm 2024-01-21T07:44:37.544427+0000 mgr.y (mgr.14140) 301 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:38.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:38.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:38.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:38.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:38.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:38.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: cephadm 2024-01-21T07:44:37.544427+0000 mgr.y (mgr.14140) 301 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:38.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:38.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:38.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:38.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:38.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:38.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: cephadm 2024-01-21T07:44:37.544735+0000 mgr.y (mgr.14140) 302 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:38.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[13909]: cephadm 2024-01-21T07:44:37.552128+0000 mgr.y (mgr.14140) 303 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: cephadm 2024-01-21T07:44:37.544735+0000 mgr.y (mgr.14140) 302 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:38.319 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:38.320 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:37 smithi080 bash[17460]: cephadm 2024-01-21T07:44:37.552128+0000 mgr.y (mgr.14140) 303 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:44:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:39 smithi080 bash[13909]: cluster 2024-01-21T07:44:37.785367+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 809 B/s rd, 4.4 KiB/s wr, 16 op/s 2024-01-21T07:44:40.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:39 smithi080 bash[17460]: cluster 2024-01-21T07:44:37.785367+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 809 B/s rd, 4.4 KiB/s wr, 16 op/s 2024-01-21T07:44:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:39 smithi195 bash[13978]: cluster 2024-01-21T07:44:37.785367+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 809 B/s rd, 4.4 KiB/s wr, 16 op/s 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: debug 2024-01-21T07:44:41.281+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:41.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:44:41.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:41.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:41.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:41.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: cluster 2024-01-21T07:44:39.786125+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 716 B/s rd, 3.9 KiB/s wr, 14 op/s 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.287295+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.295046+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.296969+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.302138+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.303284+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.308326+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-01-21T07:44:41.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.309569+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-01-21T07:44:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.316624+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-01-21T07:44:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.317882+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:44:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:41 smithi195 bash[13978]: audit 2024-01-21T07:44:41.319216+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi195.uawmcm", "key": "container_image"}]: dispatch 2024-01-21T07:44:42.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: cluster 2024-01-21T07:44:39.786125+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 716 B/s rd, 3.9 KiB/s wr, 14 op/s 2024-01-21T07:44:42.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.287295+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-01-21T07:44:42.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.295046+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.296969+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.302138+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.303284+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.308326+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.309569+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.316624+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.317882+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[13909]: audit 2024-01-21T07:44:41.319216+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi195.uawmcm", "key": "container_image"}]: dispatch 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: cluster 2024-01-21T07:44:39.786125+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 716 B/s rd, 3.9 KiB/s wr, 14 op/s 2024-01-21T07:44:42.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.287295+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.295046+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.296969+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.302138+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.303284+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.308326+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.309569+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.316624+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.317882+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:44:42.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:41 smithi080 bash[17460]: audit 2024-01-21T07:44:41.319216+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi195.uawmcm", "key": "container_image"}]: dispatch 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: cephadm 2024-01-21T07:44:41.285195+0000 mgr.y (mgr.14140) 306 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: cephadm 2024-01-21T07:44:41.285195+0000 mgr.y (mgr.14140) 306 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:43.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:43.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: cephadm 2024-01-21T07:44:41.285438+0000 mgr.y (mgr.14140) 307 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[13909]: cephadm 2024-01-21T07:44:41.318754+0000 mgr.y (mgr.14140) 308 : cephadm [INF] Deploying daemon rgw.r.z.smithi195.uawmcm on smithi195 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: cephadm 2024-01-21T07:44:41.285438+0000 mgr.y (mgr.14140) 307 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:43.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:43.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:42 smithi080 bash[17460]: cephadm 2024-01-21T07:44:41.318754+0000 mgr.y (mgr.14140) 308 : cephadm [INF] Deploying daemon rgw.r.z.smithi195.uawmcm on smithi195 2024-01-21T07:44:43.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: cephadm 2024-01-21T07:44:41.285195+0000 mgr.y (mgr.14140) 306 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:43.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:43.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: cephadm 2024-01-21T07:44:41.285438+0000 mgr.y (mgr.14140) 307 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:43.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:43.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:42 smithi195 bash[13978]: cephadm 2024-01-21T07:44:41.318754+0000 mgr.y (mgr.14140) 308 : cephadm [INF] Deploying daemon rgw.r.z.smithi195.uawmcm on smithi195 2024-01-21T07:44:44.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:43 smithi080 bash[13909]: cluster 2024-01-21T07:44:41.787472+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 605 B/s rd, 3.3 KiB/s wr, 12 op/s 2024-01-21T07:44:44.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:43 smithi080 bash[17460]: cluster 2024-01-21T07:44:41.787472+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 605 B/s rd, 3.3 KiB/s wr, 12 op/s 2024-01-21T07:44:44.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:43 smithi195 bash[13978]: cluster 2024-01-21T07:44:41.787472+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 605 B/s rd, 3.3 KiB/s wr, 12 op/s 2024-01-21T07:44:45.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: cluster 2024-01-21T07:44:43.788290+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 2.4 KiB/s wr, 9 op/s 2024-01-21T07:44:45.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: cluster 2024-01-21T07:44:43.788290+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 2.4 KiB/s wr, 9 op/s 2024-01-21T07:44:45.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: audit 2024-01-21T07:44:43.850943+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:44:45.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: audit 2024-01-21T07:44:43.856578+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:44:45.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: audit 2024-01-21T07:44:43.857868+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-01-21T07:44:45.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: audit 2024-01-21T07:44:43.863524+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-01-21T07:44:45.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: audit 2024-01-21T07:44:43.864855+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: cephadm 2024-01-21T07:44:43.865959+0000 mgr.y (mgr.14140) 311 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.bytdbv on smithi080 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[17460]: audit 2024-01-21T07:44:43.866518+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi080.bytdbv", "key": "container_image"}]: dispatch 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: audit 2024-01-21T07:44:43.850943+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: audit 2024-01-21T07:44:43.856578+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: audit 2024-01-21T07:44:43.857868+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: audit 2024-01-21T07:44:43.863524+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-01-21T07:44:45.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: audit 2024-01-21T07:44:43.864855+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:44:45.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: cephadm 2024-01-21T07:44:43.865959+0000 mgr.y (mgr.14140) 311 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.bytdbv on smithi080 2024-01-21T07:44:45.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:44 smithi080 bash[13909]: audit 2024-01-21T07:44:43.866518+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi080.bytdbv", "key": "container_image"}]: dispatch 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: cluster 2024-01-21T07:44:43.788290+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 341 B/s rd, 2.4 KiB/s wr, 9 op/s 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: audit 2024-01-21T07:44:43.850943+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: audit 2024-01-21T07:44:43.856578+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290158\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290363\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290461\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290579\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290680\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290772\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2024-01-21T07:43:15.290863\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:43:15.290917\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: audit 2024-01-21T07:44:43.857868+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: audit 2024-01-21T07:44:43.863524+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: audit 2024-01-21T07:44:43.864855+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: cephadm 2024-01-21T07:44:43.865959+0000 mgr.y (mgr.14140) 311 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.bytdbv on smithi080 2024-01-21T07:44:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:44 smithi195 bash[13978]: audit 2024-01-21T07:44:43.866518+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi080.bytdbv", "key": "container_image"}]: dispatch 2024-01-21T07:44:47.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[13909]: cluster 2024-01-21T07:44:45.789312+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 426 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-01-21T07:44:47.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[17460]: cluster 2024-01-21T07:44:45.789312+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 426 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-01-21T07:44:47.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[13909]: audit 2024-01-21T07:44:46.379137+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:44:47.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[13909]: audit 2024-01-21T07:44:46.382618+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:44:47.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[13909]: audit 2024-01-21T07:44:46.383618+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:44:47.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[17460]: audit 2024-01-21T07:44:46.379137+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:44:47.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[17460]: audit 2024-01-21T07:44:46.382618+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:44:47.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:46 smithi080 bash[17460]: audit 2024-01-21T07:44:46.383618+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:44:47.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:46 smithi195 bash[13978]: cluster 2024-01-21T07:44:45.789312+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 426 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-01-21T07:44:47.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:46 smithi195 bash[13978]: audit 2024-01-21T07:44:46.379137+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:44:47.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:46 smithi195 bash[13978]: audit 2024-01-21T07:44:46.382618+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465784\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.465975\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466091\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466203\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466313\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466423\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466534\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:42:33.466706\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:44:47.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:46 smithi195 bash[13978]: audit 2024-01-21T07:44:46.383618+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:44:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:47 smithi195 bash[13978]: audit 2024-01-21T07:44:47.521204+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:44:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:47 smithi195 bash[13978]: audit 2024-01-21T07:44:47.525919+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:44:48.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:47 smithi195 bash[13978]: audit 2024-01-21T07:44:47.527057+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:44:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:47 smithi080 bash[13909]: audit 2024-01-21T07:44:47.521204+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:44:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:47 smithi080 bash[13909]: audit 2024-01-21T07:44:47.525919+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:44:48.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:47 smithi080 bash[13909]: audit 2024-01-21T07:44:47.527057+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:44:48.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:47 smithi080 bash[17460]: audit 2024-01-21T07:44:47.521204+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]: dispatch 2024-01-21T07:44:48.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:47 smithi080 bash[17460]: audit 2024-01-21T07:44:47.525919+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:37:11.861930\"}"}]': finished 2024-01-21T07:44:48.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:47 smithi080 bash[17460]: audit 2024-01-21T07:44:47.527057+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:44:49.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:48 smithi195 bash[13978]: cluster 2024-01-21T07:44:47.790275+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 26 KiB/s rd, 85 B/s wr, 51 op/s 2024-01-21T07:44:49.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:48 smithi195 bash[13978]: audit 2024-01-21T07:44:48.373416+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370216\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:44:48.371294\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:44:49.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:48 smithi195 bash[13978]: audit 2024-01-21T07:44:48.379939+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370216\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:44:48.371294\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:44:49.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:48 smithi195 bash[13978]: cephadm 2024-01-21T07:44:48.384917+0000 mgr.y (mgr.14140) 314 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:49.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[13909]: cluster 2024-01-21T07:44:47.790275+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 26 KiB/s rd, 85 B/s wr, 51 op/s 2024-01-21T07:44:49.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[17460]: cluster 2024-01-21T07:44:47.790275+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 26 KiB/s rd, 85 B/s wr, 51 op/s 2024-01-21T07:44:49.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[13909]: audit 2024-01-21T07:44:48.373416+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370216\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:44:48.371294\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:44:49.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[13909]: audit 2024-01-21T07:44:48.379939+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370216\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:44:48.371294\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:44:49.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[13909]: cephadm 2024-01-21T07:44:48.384917+0000 mgr.y (mgr.14140) 314 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:49.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[17460]: audit 2024-01-21T07:44:48.373416+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370216\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:44:48.371294\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:44:49.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[17460]: audit 2024-01-21T07:44:48.379939+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"8769f1513fd3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370216\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:38:51.949457\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:49.433330\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:44:48.371294\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:44:49.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:48 smithi080 bash[17460]: cephadm 2024-01-21T07:44:48.384917+0000 mgr.y (mgr.14140) 314 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:51.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:50 smithi195 bash[13978]: cluster 2024-01-21T07:44:49.791085+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 38 KiB/s rd, 85 B/s wr, 73 op/s 2024-01-21T07:44:51.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:50 smithi080 bash[13909]: cluster 2024-01-21T07:44:49.791085+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 38 KiB/s rd, 85 B/s wr, 73 op/s 2024-01-21T07:44:51.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:50 smithi080 bash[17460]: cluster 2024-01-21T07:44:49.791085+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 38 KiB/s rd, 85 B/s wr, 73 op/s 2024-01-21T07:44:52.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: debug 2024-01-21T07:44:52.137+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:52.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:52.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:52.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:52.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:52.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:52.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:52.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:52.563 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:52.563 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: cluster 2024-01-21T07:44:51.792122+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 74 KiB/s rd, 170 B/s wr, 135 op/s 2024-01-21T07:44:53.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: cephadm 2024-01-21T07:44:52.142014+0000 mgr.y (mgr.14140) 317 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:53.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:53.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:53.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:53.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:53.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:53.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:53.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:44:53.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.144 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:53.144 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:53.144 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:53.144 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.144 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.145 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.145 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:53.145 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:53.145 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.145 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: cephadm 2024-01-21T07:44:52.142321+0000 mgr.y (mgr.14140) 318 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.146 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.146 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.146 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.146 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.147 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.147 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:53.147 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:53.147 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:53.147 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.148 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.148 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.148 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:53.148 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:53.148 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.148 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:52 smithi195 bash[13978]: cephadm 2024-01-21T07:44:52.149492+0000 mgr.y (mgr.14140) 319 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: cluster 2024-01-21T07:44:51.792122+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 74 KiB/s rd, 170 B/s wr, 135 op/s 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: cephadm 2024-01-21T07:44:52.142014+0000 mgr.y (mgr.14140) 317 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: cluster 2024-01-21T07:44:51.792122+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 74 KiB/s rd, 170 B/s wr, 135 op/s 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: cephadm 2024-01-21T07:44:52.142014+0000 mgr.y (mgr.14140) 317 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:53.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: cephadm 2024-01-21T07:44:52.142321+0000 mgr.y (mgr.14140) 318 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:53.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[13909]: cephadm 2024-01-21T07:44:52.149492+0000 mgr.y (mgr.14140) 319 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: cephadm 2024-01-21T07:44:52.142321+0000 mgr.y (mgr.14140) 318 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:44:53.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:44:53.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:52 smithi080 bash[17460]: cephadm 2024-01-21T07:44:52.149492+0000 mgr.y (mgr.14140) 319 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:44:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:55 smithi080 bash[13909]: cluster 2024-01-21T07:44:53.793183+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:44:56.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:55 smithi080 bash[17460]: cluster 2024-01-21T07:44:53.793183+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:44:56.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:55 smithi195 bash[13978]: cluster 2024-01-21T07:44:53.793183+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:44:56.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: debug 2024-01-21T07:44:56.141+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:56.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:56.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:44:56.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:44:56.562 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:56 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: cluster 2024-01-21T07:44:55.794272+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: cephadm 2024-01-21T07:44:56.146503+0000 mgr.y (mgr.14140) 322 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:58.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: cluster 2024-01-21T07:44:55.794272+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:44:58.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: cephadm 2024-01-21T07:44:56.146503+0000 mgr.y (mgr.14140) 322 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:58.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: cephadm 2024-01-21T07:44:56.146768+0000 mgr.y (mgr.14140) 323 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[13909]: cephadm 2024-01-21T07:44:56.155556+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: cephadm 2024-01-21T07:44:56.146768+0000 mgr.y (mgr.14140) 323 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:44:58.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.067 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:57 smithi080 bash[17460]: cephadm 2024-01-21T07:44:56.155556+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:44:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: cluster 2024-01-21T07:44:55.794272+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:44:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: cephadm 2024-01-21T07:44:56.146503+0000 mgr.y (mgr.14140) 322 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:58.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: cephadm 2024-01-21T07:44:56.146768+0000 mgr.y (mgr.14140) 323 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr latest: Pulling from prom/alertmanager 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:44:58.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:44:58.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:57 smithi195 bash[13978]: cephadm 2024-01-21T07:44:56.155556+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:45:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[13909]: cluster 2024-01-21T07:44:57.795786+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:45:00.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: debug 2024-01-21T07:44:59.889+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:45:00.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:00.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:00.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:45:00.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:45:00.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:00.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:44:59 smithi080 bash[17460]: cluster 2024-01-21T07:44:57.795786+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:45:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:44:59 smithi195 bash[13978]: cluster 2024-01-21T07:44:57.795786+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: cluster 2024-01-21T07:44:59.796583+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 85 B/s wr, 114 op/s 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: cephadm 2024-01-21T07:44:59.890679+0000 mgr.y (mgr.14140) 327 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: cluster 2024-01-21T07:44:59.796583+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 85 B/s wr, 114 op/s 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: cephadm 2024-01-21T07:44:59.890679+0000 mgr.y (mgr.14140) 327 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:02.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:45:02.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: cephadm 2024-01-21T07:44:59.891026+0000 mgr.y (mgr.14140) 328 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:02.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[13909]: cephadm 2024-01-21T07:44:59.898480+0000 mgr.y (mgr.14140) 329 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: cephadm 2024-01-21T07:44:59.891026+0000 mgr.y (mgr.14140) 328 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:01 smithi080 bash[17460]: cephadm 2024-01-21T07:44:59.898480+0000 mgr.y (mgr.14140) 329 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:45:02.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: cluster 2024-01-21T07:44:59.796583+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 85 B/s wr, 114 op/s 2024-01-21T07:45:02.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: cephadm 2024-01-21T07:44:59.890679+0000 mgr.y (mgr.14140) 327 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: cephadm 2024-01-21T07:44:59.891026+0000 mgr.y (mgr.14140) 328 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:45:02.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:02.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:45:02.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:45:02.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:45:02.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:01 smithi195 bash[13978]: cephadm 2024-01-21T07:44:59.898480+0000 mgr.y (mgr.14140) 329 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:45:03.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:02 smithi195 bash[13978]: cluster 2024-01-21T07:45:01.797615+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 92 op/s 2024-01-21T07:45:03.232 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:02 smithi080 bash[13909]: cluster 2024-01-21T07:45:01.797615+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 92 op/s 2024-01-21T07:45:03.232 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:02 smithi080 bash[17460]: cluster 2024-01-21T07:45:01.797615+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 92 op/s 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: debug 2024-01-21T07:45:03.649+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:04.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:04.060 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:45:04.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:45:03 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: cephadm 2024-01-21T07:45:03.652348+0000 mgr.y (mgr.14140) 331 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: cephadm 2024-01-21T07:45:03.652348+0000 mgr.y (mgr.14140) 331 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:05.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.063 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: cephadm 2024-01-21T07:45:03.652678+0000 mgr.y (mgr.14140) 332 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.064 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: cephadm 2024-01-21T07:45:03.652678+0000 mgr.y (mgr.14140) 332 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:45:05.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:04 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: cephadm 2024-01-21T07:45:03.652348+0000 mgr.y (mgr.14140) 331 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: cephadm 2024-01-21T07:45:03.652678+0000 mgr.y (mgr.14140) 332 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:45:05.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:45:05.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:45:05.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:45:05.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:45:05.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:04 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:45:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:05 smithi080 bash[13909]: cluster 2024-01-21T07:45:03.798705+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-01-21T07:45:06.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:05 smithi080 bash[17460]: cluster 2024-01-21T07:45:03.798705+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-01-21T07:45:06.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:05 smithi195 bash[13978]: cluster 2024-01-21T07:45:03.798705+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-01-21T07:45:07.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:06 smithi195 bash[13978]: cluster 2024-01-21T07:45:05.799789+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:07.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:06 smithi080 bash[13909]: cluster 2024-01-21T07:45:05.799789+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:07.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:06 smithi080 bash[17460]: cluster 2024-01-21T07:45:05.799789+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:10.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:09 smithi080 bash[13909]: cluster 2024-01-21T07:45:07.800955+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:09 smithi080 bash[17460]: cluster 2024-01-21T07:45:07.800955+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:10.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:09 smithi195 bash[13978]: cluster 2024-01-21T07:45:07.800955+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:12.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:11 smithi080 bash[13909]: cluster 2024-01-21T07:45:09.801793+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:12.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:11 smithi080 bash[17460]: cluster 2024-01-21T07:45:09.801793+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:12.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:11 smithi195 bash[13978]: cluster 2024-01-21T07:45:09.801793+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:13.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:12 smithi080 bash[13909]: cluster 2024-01-21T07:45:11.802889+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:13.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:12 smithi080 bash[17460]: cluster 2024-01-21T07:45:11.802889+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:13.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:12 smithi195 bash[13978]: cluster 2024-01-21T07:45:11.802889+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:16.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:15 smithi080 bash[13909]: cluster 2024-01-21T07:45:13.803960+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:16.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:15 smithi080 bash[17460]: cluster 2024-01-21T07:45:13.803960+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:16.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:15 smithi195 bash[13978]: cluster 2024-01-21T07:45:13.803960+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:17 smithi080 bash[13909]: cluster 2024-01-21T07:45:15.804926+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:18.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:17 smithi080 bash[17460]: cluster 2024-01-21T07:45:15.804926+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:18.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:17 smithi195 bash[13978]: cluster 2024-01-21T07:45:15.804926+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:20.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:19 smithi080 bash[13909]: cluster 2024-01-21T07:45:17.806056+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:20.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:19 smithi080 bash[17460]: cluster 2024-01-21T07:45:17.806056+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:20.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:19 smithi195 bash[13978]: cluster 2024-01-21T07:45:17.806056+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:22.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:21 smithi080 bash[13909]: cluster 2024-01-21T07:45:19.806802+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:22.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:21 smithi080 bash[17460]: cluster 2024-01-21T07:45:19.806802+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:22.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:21 smithi195 bash[13978]: cluster 2024-01-21T07:45:19.806802+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:23.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:22 smithi195 bash[13978]: cluster 2024-01-21T07:45:21.807944+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:23.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:22 smithi080 bash[13909]: cluster 2024-01-21T07:45:21.807944+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:23.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:22 smithi080 bash[17460]: cluster 2024-01-21T07:45:21.807944+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:26.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:25 smithi080 bash[13909]: cluster 2024-01-21T07:45:23.809004+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:26.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:25 smithi080 bash[17460]: cluster 2024-01-21T07:45:23.809004+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:26.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:25 smithi195 bash[13978]: cluster 2024-01-21T07:45:23.809004+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:27.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:26 smithi195 bash[13978]: cluster 2024-01-21T07:45:25.810111+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:26 smithi080 bash[13909]: cluster 2024-01-21T07:45:25.810111+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:27.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:26 smithi080 bash[17460]: cluster 2024-01-21T07:45:25.810111+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:29.887 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:29 smithi195 bash[13978]: cluster 2024-01-21T07:45:27.811381+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:30.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:29 smithi080 bash[13909]: cluster 2024-01-21T07:45:27.811381+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:30.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:29 smithi080 bash[17460]: cluster 2024-01-21T07:45:27.811381+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:32.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:31 smithi080 bash[13909]: cluster 2024-01-21T07:45:29.812170+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:32.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:31 smithi080 bash[17460]: cluster 2024-01-21T07:45:29.812170+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:32.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:31 smithi195 bash[13978]: cluster 2024-01-21T07:45:29.812170+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:33.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:32 smithi195 bash[13978]: cluster 2024-01-21T07:45:31.813268+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:32 smithi080 bash[13909]: cluster 2024-01-21T07:45:31.813268+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:33.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:32 smithi080 bash[17460]: cluster 2024-01-21T07:45:31.813268+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:36.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:35 smithi080 bash[13909]: cluster 2024-01-21T07:45:33.814247+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:36.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:35 smithi080 bash[17460]: cluster 2024-01-21T07:45:33.814247+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:36.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:35 smithi195 bash[13978]: cluster 2024-01-21T07:45:33.814247+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:37.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:36 smithi195 bash[13978]: cluster 2024-01-21T07:45:35.815361+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:37.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:36 smithi080 bash[13909]: cluster 2024-01-21T07:45:35.815361+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:37.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:36 smithi080 bash[17460]: cluster 2024-01-21T07:45:35.815361+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:40.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:39 smithi080 bash[13909]: cluster 2024-01-21T07:45:37.816378+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:40.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:39 smithi080 bash[17460]: cluster 2024-01-21T07:45:37.816378+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:40.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:39 smithi195 bash[13978]: cluster 2024-01-21T07:45:37.816378+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:42.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:41 smithi080 bash[13909]: cluster 2024-01-21T07:45:39.817187+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:42.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:41 smithi080 bash[17460]: cluster 2024-01-21T07:45:39.817187+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:42.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:41 smithi195 bash[13978]: cluster 2024-01-21T07:45:39.817187+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:43.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:42 smithi195 bash[13978]: cluster 2024-01-21T07:45:41.818350+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:43.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:42 smithi080 bash[13909]: cluster 2024-01-21T07:45:41.818350+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:43.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:42 smithi080 bash[17460]: cluster 2024-01-21T07:45:41.818350+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:46.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:45 smithi080 bash[13909]: cluster 2024-01-21T07:45:43.819251+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:46.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:45 smithi080 bash[17460]: cluster 2024-01-21T07:45:43.819251+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:46.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:45 smithi195 bash[13978]: cluster 2024-01-21T07:45:43.819251+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:47.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:46 smithi195 bash[13978]: cluster 2024-01-21T07:45:45.820368+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:47.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:46 smithi080 bash[13909]: cluster 2024-01-21T07:45:45.820368+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:47.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:46 smithi080 bash[17460]: cluster 2024-01-21T07:45:45.820368+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:50.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:49 smithi080 bash[13909]: cluster 2024-01-21T07:45:47.821527+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:50.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:49 smithi080 bash[17460]: cluster 2024-01-21T07:45:47.821527+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:50.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:49 smithi195 bash[13978]: cluster 2024-01-21T07:45:47.821527+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:51.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:50 smithi195 bash[13978]: cluster 2024-01-21T07:45:49.822397+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:51.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:50 smithi080 bash[13909]: cluster 2024-01-21T07:45:49.822397+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:51.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:50 smithi080 bash[17460]: cluster 2024-01-21T07:45:49.822397+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:53.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:52 smithi195 bash[13978]: cluster 2024-01-21T07:45:51.823473+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:53.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:52 smithi080 bash[13909]: cluster 2024-01-21T07:45:51.823473+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:53.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:52 smithi080 bash[17460]: cluster 2024-01-21T07:45:51.823473+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:56.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:55 smithi080 bash[13909]: cluster 2024-01-21T07:45:53.824445+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:56.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:55 smithi080 bash[17460]: cluster 2024-01-21T07:45:53.824445+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:55 smithi195 bash[13978]: cluster 2024-01-21T07:45:53.824445+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:57.137 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:56 smithi195 bash[13978]: cluster 2024-01-21T07:45:55.825529+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:56 smithi080 bash[13909]: cluster 2024-01-21T07:45:55.825529+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:45:57.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:56 smithi080 bash[17460]: cluster 2024-01-21T07:45:55.825529+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:45:59 smithi080 bash[13909]: cluster 2024-01-21T07:45:57.826584+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:00.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:45:59 smithi080 bash[17460]: cluster 2024-01-21T07:45:57.826584+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:45:59 smithi195 bash[13978]: cluster 2024-01-21T07:45:57.826584+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:01.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:00 smithi195 bash[13978]: cluster 2024-01-21T07:45:59.827269+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:01.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:00 smithi080 bash[13909]: cluster 2024-01-21T07:45:59.827269+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:01.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:00 smithi080 bash[17460]: cluster 2024-01-21T07:45:59.827269+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:03.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:02 smithi195 bash[13978]: cluster 2024-01-21T07:46:01.828374+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:03.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:02 smithi080 bash[13909]: cluster 2024-01-21T07:46:01.828374+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:03.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:02 smithi080 bash[17460]: cluster 2024-01-21T07:46:01.828374+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:06.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:05 smithi080 bash[13909]: cluster 2024-01-21T07:46:03.829499+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:06.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:05 smithi080 bash[17460]: cluster 2024-01-21T07:46:03.829499+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:05 smithi195 bash[13978]: cluster 2024-01-21T07:46:03.829499+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:07.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:06 smithi195 bash[13978]: cluster 2024-01-21T07:46:05.830693+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:07.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:06 smithi080 bash[13909]: cluster 2024-01-21T07:46:05.830693+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:07.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:06 smithi080 bash[17460]: cluster 2024-01-21T07:46:05.830693+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:10.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:09 smithi080 bash[13909]: cluster 2024-01-21T07:46:07.831808+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:10.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:09 smithi080 bash[17460]: cluster 2024-01-21T07:46:07.831808+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:10.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:09 smithi195 bash[13978]: cluster 2024-01-21T07:46:07.831808+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:11.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:10 smithi195 bash[13978]: cluster 2024-01-21T07:46:09.832645+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:11.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:10 smithi080 bash[13909]: cluster 2024-01-21T07:46:09.832645+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:11.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:10 smithi080 bash[17460]: cluster 2024-01-21T07:46:09.832645+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:13.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:12 smithi195 bash[13978]: cluster 2024-01-21T07:46:11.833719+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:13.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:12 smithi080 bash[13909]: cluster 2024-01-21T07:46:11.833719+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:13.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:12 smithi080 bash[17460]: cluster 2024-01-21T07:46:11.833719+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:15 smithi195 bash[13978]: cluster 2024-01-21T07:46:13.834882+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:16.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:15 smithi080 bash[13909]: cluster 2024-01-21T07:46:13.834882+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:16.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:15 smithi080 bash[17460]: cluster 2024-01-21T07:46:13.834882+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:17.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:16 smithi195 bash[13978]: cluster 2024-01-21T07:46:15.835894+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:16 smithi080 bash[13909]: cluster 2024-01-21T07:46:15.835894+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:17.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:16 smithi080 bash[17460]: cluster 2024-01-21T07:46:15.835894+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:19 smithi195 bash[13978]: cluster 2024-01-21T07:46:17.836924+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:20.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:19 smithi080 bash[13909]: cluster 2024-01-21T07:46:17.836924+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:20.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:19 smithi080 bash[17460]: cluster 2024-01-21T07:46:17.836924+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:21.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:20 smithi195 bash[13978]: cluster 2024-01-21T07:46:19.837717+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:20 smithi080 bash[13909]: cluster 2024-01-21T07:46:19.837717+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:20 smithi080 bash[17460]: cluster 2024-01-21T07:46:19.837717+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:23.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:22 smithi080 bash[13909]: cluster 2024-01-21T07:46:21.838779+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:23.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:22 smithi080 bash[17460]: cluster 2024-01-21T07:46:21.838779+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:23.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:22 smithi195 bash[13978]: cluster 2024-01-21T07:46:21.838779+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:25.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:24 smithi195 bash[13978]: cluster 2024-01-21T07:46:23.839848+0000 mgr.y (mgr.14140) 373 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:24 smithi080 bash[13909]: cluster 2024-01-21T07:46:23.839848+0000 mgr.y (mgr.14140) 373 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:24 smithi080 bash[17460]: cluster 2024-01-21T07:46:23.839848+0000 mgr.y (mgr.14140) 373 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:26 smithi080 bash[13909]: cluster 2024-01-21T07:46:25.840888+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:27.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:26 smithi080 bash[17460]: cluster 2024-01-21T07:46:25.840888+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:27.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:26 smithi195 bash[13978]: cluster 2024-01-21T07:46:25.840888+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:29.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:28 smithi080 bash[17460]: cluster 2024-01-21T07:46:27.841925+0000 mgr.y (mgr.14140) 375 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:28 smithi080 bash[13909]: cluster 2024-01-21T07:46:27.841925+0000 mgr.y (mgr.14140) 375 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:29.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:28 smithi195 bash[13978]: cluster 2024-01-21T07:46:27.841925+0000 mgr.y (mgr.14140) 375 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:30 smithi080 bash[13909]: cluster 2024-01-21T07:46:29.842838+0000 mgr.y (mgr.14140) 376 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:31.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:30 smithi080 bash[17460]: cluster 2024-01-21T07:46:29.842838+0000 mgr.y (mgr.14140) 376 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:31.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:30 smithi195 bash[13978]: cluster 2024-01-21T07:46:29.842838+0000 mgr.y (mgr.14140) 376 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:32 smithi080 bash[13909]: cluster 2024-01-21T07:46:31.843841+0000 mgr.y (mgr.14140) 377 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:33.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:32 smithi080 bash[17460]: cluster 2024-01-21T07:46:31.843841+0000 mgr.y (mgr.14140) 377 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:33.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:32 smithi195 bash[13978]: cluster 2024-01-21T07:46:31.843841+0000 mgr.y (mgr.14140) 377 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:35.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:34 smithi195 bash[13978]: cluster 2024-01-21T07:46:33.844952+0000 mgr.y (mgr.14140) 378 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:35.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:34 smithi080 bash[13909]: cluster 2024-01-21T07:46:33.844952+0000 mgr.y (mgr.14140) 378 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:35.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:34 smithi080 bash[17460]: cluster 2024-01-21T07:46:33.844952+0000 mgr.y (mgr.14140) 378 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:37.186 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:36 smithi080 bash[13909]: cluster 2024-01-21T07:46:35.845932+0000 mgr.y (mgr.14140) 379 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:37.187 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:36 smithi080 bash[17460]: cluster 2024-01-21T07:46:35.845932+0000 mgr.y (mgr.14140) 379 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:37.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:36 smithi195 bash[13978]: cluster 2024-01-21T07:46:35.845932+0000 mgr.y (mgr.14140) 379 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:37.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-01-21T07:46:38.961 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:38 smithi080 bash[13909]: cluster 2024-01-21T07:46:37.846739+0000 mgr.y (mgr.14140) 380 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:38.961 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:38 smithi080 bash[17460]: cluster 2024-01-21T07:46:37.846739+0000 mgr.y (mgr.14140) 380 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:39.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:38 smithi195 bash[13978]: cluster 2024-01-21T07:46:37.846739+0000 mgr.y (mgr.14140) 380 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:41.033 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-01-21T07:46:41.170 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:40 smithi080 bash[13909]: cluster 2024-01-21T07:46:39.847552+0000 mgr.y (mgr.14140) 381 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:41.170 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:40 smithi080 bash[13909]: audit 2024-01-21T07:46:40.315094+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.15.80:0/125903186' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-01-21T07:46:41.170 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:40 smithi080 bash[13909]: audit 2024-01-21T07:46:40.324344+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.80:0/125903186' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-01-21T07:46:41.170 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:40 smithi080 bash[17460]: cluster 2024-01-21T07:46:39.847552+0000 mgr.y (mgr.14140) 381 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:41.170 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:40 smithi080 bash[17460]: audit 2024-01-21T07:46:40.315094+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.15.80:0/125903186' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-01-21T07:46:41.170 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:40 smithi080 bash[17460]: audit 2024-01-21T07:46:40.324344+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.80:0/125903186' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-01-21T07:46:41.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:40 smithi195 bash[13978]: cluster 2024-01-21T07:46:39.847552+0000 mgr.y (mgr.14140) 381 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:41.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:40 smithi195 bash[13978]: audit 2024-01-21T07:46:40.315094+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.15.80:0/125903186' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-01-21T07:46:41.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:40 smithi195 bash[13978]: audit 2024-01-21T07:46:40.324344+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.80:0/125903186' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-01-21T07:46:43.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:42 smithi080 bash[13909]: cluster 2024-01-21T07:46:41.848353+0000 mgr.y (mgr.14140) 382 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:43.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:42 smithi080 bash[17460]: cluster 2024-01-21T07:46:41.848353+0000 mgr.y (mgr.14140) 382 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:43.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:42 smithi195 bash[13978]: cluster 2024-01-21T07:46:41.848353+0000 mgr.y (mgr.14140) 382 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:44.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:43 smithi080 bash[13909]: audit 2024-01-21T07:46:43.781528+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.80:0/2697820967' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-01-21T07:46:44.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:43 smithi080 bash[13909]: audit 2024-01-21T07:46:43.789757+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.80:0/2697820967' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-01-21T07:46:44.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:43 smithi080 bash[17460]: audit 2024-01-21T07:46:43.781528+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.80:0/2697820967' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-01-21T07:46:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:43 smithi080 bash[17460]: audit 2024-01-21T07:46:43.789757+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.80:0/2697820967' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-01-21T07:46:44.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:43 smithi195 bash[13978]: audit 2024-01-21T07:46:43.781528+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.80:0/2697820967' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-01-21T07:46:44.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:43 smithi195 bash[13978]: audit 2024-01-21T07:46:43.789757+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.80:0/2697820967' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-01-21T07:46:44.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-01-21T07:46:45.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:44 smithi080 bash[13909]: cluster 2024-01-21T07:46:43.849662+0000 mgr.y (mgr.14140) 383 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:45.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:44 smithi080 bash[17460]: cluster 2024-01-21T07:46:43.849662+0000 mgr.y (mgr.14140) 383 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:45.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:44 smithi195 bash[13978]: cluster 2024-01-21T07:46:43.849662+0000 mgr.y (mgr.14140) 383 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:47.272 INFO:teuthology.orchestra.run.smithi080.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:46:47.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:46 smithi080 bash[13909]: cluster 2024-01-21T07:46:45.850769+0000 mgr.y (mgr.14140) 384 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:47.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:46 smithi080 bash[17460]: cluster 2024-01-21T07:46:45.850769+0000 mgr.y (mgr.14140) 384 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:47.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:46 smithi195 bash[13978]: cluster 2024-01-21T07:46:45.850769+0000 mgr.y (mgr.14140) 384 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:47.963 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-21T07:46:47.972 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-01-21T07:46:47.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-01-21T07:46:48.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[13909]: audit 2024-01-21T07:46:47.256166+0000 mgr.y (mgr.14140) 385 : audit [DBG] from='client.24628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:48.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[13909]: audit 2024-01-21T07:46:47.257768+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\"}"}]: dispatch 2024-01-21T07:46:48.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[13909]: audit 2024-01-21T07:46:47.263761+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\"}"}]': finished 2024-01-21T07:46:48.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[13909]: cephadm 2024-01-21T07:46:47.269942+0000 mgr.y (mgr.14140) 386 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:46:48.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[17460]: audit 2024-01-21T07:46:47.256166+0000 mgr.y (mgr.14140) 385 : audit [DBG] from='client.24628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:48.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[17460]: audit 2024-01-21T07:46:47.257768+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\"}"}]: dispatch 2024-01-21T07:46:48.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[17460]: audit 2024-01-21T07:46:47.263761+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\"}"}]': finished 2024-01-21T07:46:48.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:47 smithi080 bash[17460]: cephadm 2024-01-21T07:46:47.269942+0000 mgr.y (mgr.14140) 386 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:46:48.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:47 smithi195 bash[13978]: audit 2024-01-21T07:46:47.256166+0000 mgr.y (mgr.14140) 385 : audit [DBG] from='client.24628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:48.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:47 smithi195 bash[13978]: audit 2024-01-21T07:46:47.257768+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\"}"}]: dispatch 2024-01-21T07:46:48.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:47 smithi195 bash[13978]: audit 2024-01-21T07:46:47.263761+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\"}"}]': finished 2024-01-21T07:46:48.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:47 smithi195 bash[13978]: cephadm 2024-01-21T07:46:47.269942+0000 mgr.y (mgr.14140) 386 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:46:49.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:49 smithi080 bash[13909]: cluster 2024-01-21T07:46:47.851857+0000 mgr.y (mgr.14140) 387 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:49.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:49 smithi080 bash[17460]: cluster 2024-01-21T07:46:47.851857+0000 mgr.y (mgr.14140) 387 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:49.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:49 smithi195 bash[13978]: cluster 2024-01-21T07:46:47.851857+0000 mgr.y (mgr.14140) 387 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:50.872 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:46:51.534 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-01-21T07:46:51.534 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (3m) 2m ago 3m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d6c769fa64de 2024-01-21T07:46:51.534 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8769f1513fd3 2024-01-21T07:46:51.534 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:46:51.534 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 2m ago 4m prom/node-exporter 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 2m ago 4m prom/node-exporter 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (5m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:46:51.535 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:46:51.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[13909]: cluster 2024-01-21T07:46:49.852770+0000 mgr.y (mgr.14140) 388 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:51.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[17460]: cluster 2024-01-21T07:46:49.852770+0000 mgr.y (mgr.14140) 388 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:51.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: debug 2024-01-21T07:46:51.306+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:51.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:46:51.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:51.560 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:46:51.561 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:51 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:51.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:51 smithi195 bash[13978]: cluster 2024-01-21T07:46:49.852770+0000 mgr.y (mgr.14140) 388 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:51.877 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:46:51.878 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:46:51.879 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-01-21T07:46:51.879 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:46:51.879 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:46:52.197 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:46:52.197 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:46:52.198 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:46:52.198 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:46:52.198 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "" 2024-01-21T07:46:52.198 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: audit 2024-01-21T07:46:50.857350+0000 mgr.y (mgr.14140) 389 : audit [DBG] from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: audit 2024-01-21T07:46:51.181499+0000 mgr.y (mgr.14140) 390 : audit [DBG] from='client.24640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: cephadm 2024-01-21T07:46:51.313520+0000 mgr.y (mgr.14140) 391 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: audit 2024-01-21T07:46:50.857350+0000 mgr.y (mgr.14140) 389 : audit [DBG] from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: audit 2024-01-21T07:46:51.181499+0000 mgr.y (mgr.14140) 390 : audit [DBG] from='client.24640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: cephadm 2024-01-21T07:46:51.313520+0000 mgr.y (mgr.14140) 391 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:46:52.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: cephadm 2024-01-21T07:46:51.313696+0000 mgr.y (mgr.14140) 392 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: cephadm 2024-01-21T07:46:51.320370+0000 mgr.y (mgr.14140) 393 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: audit 2024-01-21T07:46:51.518098+0000 mgr.y (mgr.14140) 394 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[13909]: audit 2024-01-21T07:46:51.876013+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.80:0/1980903106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: cephadm 2024-01-21T07:46:51.313696+0000 mgr.y (mgr.14140) 392 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: cephadm 2024-01-21T07:46:51.320370+0000 mgr.y (mgr.14140) 393 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: audit 2024-01-21T07:46:51.518098+0000 mgr.y (mgr.14140) 394 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:52 smithi080 bash[17460]: audit 2024-01-21T07:46:51.876013+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.80:0/1980903106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:46:52.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: audit 2024-01-21T07:46:50.857350+0000 mgr.y (mgr.14140) 389 : audit [DBG] from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: audit 2024-01-21T07:46:51.181499+0000 mgr.y (mgr.14140) 390 : audit [DBG] from='client.24640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: cephadm 2024-01-21T07:46:51.313520+0000 mgr.y (mgr.14140) 391 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:46:52.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: cephadm 2024-01-21T07:46:51.313696+0000 mgr.y (mgr.14140) 392 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:46:52.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:46:52.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: cephadm 2024-01-21T07:46:51.320370+0000 mgr.y (mgr.14140) 393 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:46:52.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: audit 2024-01-21T07:46:51.518098+0000 mgr.y (mgr.14140) 394 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:52.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:52 smithi195 bash[13978]: audit 2024-01-21T07:46:51.876013+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.80:0/1980903106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:46:53.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:53 smithi080 bash[13909]: cluster 2024-01-21T07:46:51.853700+0000 mgr.y (mgr.14140) 395 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:53.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:53 smithi080 bash[13909]: audit 2024-01-21T07:46:52.195424+0000 mgr.y (mgr.14140) 396 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:53.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:53 smithi080 bash[17460]: cluster 2024-01-21T07:46:51.853700+0000 mgr.y (mgr.14140) 395 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:53.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:53 smithi080 bash[17460]: audit 2024-01-21T07:46:52.195424+0000 mgr.y (mgr.14140) 396 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:53.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:53 smithi195 bash[13978]: cluster 2024-01-21T07:46:51.853700+0000 mgr.y (mgr.14140) 395 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:53.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:53 smithi195 bash[13978]: audit 2024-01-21T07:46:52.195424+0000 mgr.y (mgr.14140) 396 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:46:54.974 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:54 smithi080 bash[13909]: cluster 2024-01-21T07:46:53.854810+0000 mgr.y (mgr.14140) 397 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:54.974 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:54 smithi080 bash[17460]: cluster 2024-01-21T07:46:53.854810+0000 mgr.y (mgr.14140) 397 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:54 smithi195 bash[13978]: cluster 2024-01-21T07:46:53.854810+0000 mgr.y (mgr.14140) 397 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:55.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: debug 2024-01-21T07:46:55.022+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:55.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:46:55.310 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:46:55.311 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.839 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: cephadm 2024-01-21T07:46:55.028220+0000 mgr.y (mgr.14140) 398 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:46:55.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:55.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:46:55.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: cephadm 2024-01-21T07:46:55.028220+0000 mgr.y (mgr.14140) 398 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:55.843 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: cephadm 2024-01-21T07:46:55.028513+0000 mgr.y (mgr.14140) 399 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:46:55.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:46:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:46:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:55.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[13909]: cephadm 2024-01-21T07:46:55.030450+0000 mgr.y (mgr.14140) 400 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:46:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: cephadm 2024-01-21T07:46:55.028220+0000 mgr.y (mgr.14140) 398 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:46:56.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:56.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: cephadm 2024-01-21T07:46:55.028513+0000 mgr.y (mgr.14140) 399 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:55 smithi195 bash[13978]: cephadm 2024-01-21T07:46:55.030450+0000 mgr.y (mgr.14140) 400 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:46:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:46:56.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: cephadm 2024-01-21T07:46:55.028513+0000 mgr.y (mgr.14140) 399 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:46:56.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:46:56.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:46:56.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:46:56.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:46:56.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:46:56.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:46:56.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:55 smithi080 bash[17460]: cephadm 2024-01-21T07:46:55.030450+0000 mgr.y (mgr.14140) 400 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:46:57.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:56 smithi195 bash[13978]: cluster 2024-01-21T07:46:55.855704+0000 mgr.y (mgr.14140) 401 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:56 smithi080 bash[13909]: cluster 2024-01-21T07:46:55.855704+0000 mgr.y (mgr.14140) 401 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:57.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:56 smithi080 bash[17460]: cluster 2024-01-21T07:46:55.855704+0000 mgr.y (mgr.14140) 401 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:59.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:46:58 smithi080 bash[13909]: cluster 2024-01-21T07:46:57.856606+0000 mgr.y (mgr.14140) 402 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:59.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:46:58 smithi080 bash[17460]: cluster 2024-01-21T07:46:57.856606+0000 mgr.y (mgr.14140) 402 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:46:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:46:58 smithi195 bash[13978]: cluster 2024-01-21T07:46:57.856606+0000 mgr.y (mgr.14140) 402 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:01.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:00 smithi080 bash[13909]: cluster 2024-01-21T07:46:59.857461+0000 mgr.y (mgr.14140) 403 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:01.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:00 smithi080 bash[17460]: cluster 2024-01-21T07:46:59.857461+0000 mgr.y (mgr.14140) 403 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:01.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:00 smithi195 bash[13978]: cluster 2024-01-21T07:46:59.857461+0000 mgr.y (mgr.14140) 403 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:03.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:02 smithi080 bash[13909]: cluster 2024-01-21T07:47:01.858261+0000 mgr.y (mgr.14140) 404 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:03.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:02 smithi080 bash[17460]: cluster 2024-01-21T07:47:01.858261+0000 mgr.y (mgr.14140) 404 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:03.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:02 smithi195 bash[13978]: cluster 2024-01-21T07:47:01.858261+0000 mgr.y (mgr.14140) 404 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:04 smithi195 bash[13978]: cluster 2024-01-21T07:47:03.859437+0000 mgr.y (mgr.14140) 405 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:05.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:04 smithi080 bash[13909]: cluster 2024-01-21T07:47:03.859437+0000 mgr.y (mgr.14140) 405 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:05.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:04 smithi080 bash[17460]: cluster 2024-01-21T07:47:03.859437+0000 mgr.y (mgr.14140) 405 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:07.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:06 smithi080 bash[13909]: cluster 2024-01-21T07:47:05.860305+0000 mgr.y (mgr.14140) 406 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:07.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:06 smithi080 bash[17460]: cluster 2024-01-21T07:47:05.860305+0000 mgr.y (mgr.14140) 406 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:07.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:06 smithi195 bash[13978]: cluster 2024-01-21T07:47:05.860305+0000 mgr.y (mgr.14140) 406 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:09.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:08 smithi080 bash[13909]: cluster 2024-01-21T07:47:07.861078+0000 mgr.y (mgr.14140) 407 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:09.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:08 smithi080 bash[17460]: cluster 2024-01-21T07:47:07.861078+0000 mgr.y (mgr.14140) 407 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:09.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:08 smithi195 bash[13978]: cluster 2024-01-21T07:47:07.861078+0000 mgr.y (mgr.14140) 407 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:11.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:10 smithi080 bash[13909]: cluster 2024-01-21T07:47:09.861988+0000 mgr.y (mgr.14140) 408 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:11.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:10 smithi080 bash[17460]: cluster 2024-01-21T07:47:09.861988+0000 mgr.y (mgr.14140) 408 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:11.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:10 smithi195 bash[13978]: cluster 2024-01-21T07:47:09.861988+0000 mgr.y (mgr.14140) 408 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:13.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:12 smithi080 bash[13909]: cluster 2024-01-21T07:47:11.862992+0000 mgr.y (mgr.14140) 409 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:13.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:12 smithi080 bash[17460]: cluster 2024-01-21T07:47:11.862992+0000 mgr.y (mgr.14140) 409 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:13.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:12 smithi195 bash[13978]: cluster 2024-01-21T07:47:11.862992+0000 mgr.y (mgr.14140) 409 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:15.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:14 smithi195 bash[13978]: cluster 2024-01-21T07:47:13.864155+0000 mgr.y (mgr.14140) 410 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:15.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:14 smithi080 bash[13909]: cluster 2024-01-21T07:47:13.864155+0000 mgr.y (mgr.14140) 410 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:15.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:14 smithi080 bash[17460]: cluster 2024-01-21T07:47:13.864155+0000 mgr.y (mgr.14140) 410 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:16 smithi080 bash[13909]: cluster 2024-01-21T07:47:15.864999+0000 mgr.y (mgr.14140) 411 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:17.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:16 smithi080 bash[17460]: cluster 2024-01-21T07:47:15.864999+0000 mgr.y (mgr.14140) 411 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:17.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:16 smithi195 bash[13978]: cluster 2024-01-21T07:47:15.864999+0000 mgr.y (mgr.14140) 411 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:19.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:18 smithi080 bash[13909]: cluster 2024-01-21T07:47:17.865956+0000 mgr.y (mgr.14140) 412 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:19.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:18 smithi080 bash[17460]: cluster 2024-01-21T07:47:17.865956+0000 mgr.y (mgr.14140) 412 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:19.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:18 smithi195 bash[13978]: cluster 2024-01-21T07:47:17.865956+0000 mgr.y (mgr.14140) 412 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:20 smithi080 bash[13909]: cluster 2024-01-21T07:47:19.866807+0000 mgr.y (mgr.14140) 413 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:21.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:20 smithi080 bash[17460]: cluster 2024-01-21T07:47:19.866807+0000 mgr.y (mgr.14140) 413 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:20 smithi195 bash[13978]: cluster 2024-01-21T07:47:19.866807+0000 mgr.y (mgr.14140) 413 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:22.591 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:47:23.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:22 smithi080 bash[13909]: cluster 2024-01-21T07:47:21.867779+0000 mgr.y (mgr.14140) 414 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:23.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:22 smithi080 bash[13909]: audit 2024-01-21T07:47:22.576085+0000 mgr.y (mgr.14140) 415 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:23.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:22 smithi080 bash[17460]: cluster 2024-01-21T07:47:21.867779+0000 mgr.y (mgr.14140) 414 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:23.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:22 smithi080 bash[17460]: audit 2024-01-21T07:47:22.576085+0000 mgr.y (mgr.14140) 415 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (4m) 2m ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d6c769fa64de 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8769f1513fd3 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 2m ago 4m prom/node-exporter 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 2m ago 4m prom/node-exporter 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:47:23.339 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:47:23.340 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:47:23.340 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:47:23.340 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:47:23.340 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:47:23.340 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:47:23.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:22 smithi195 bash[13978]: cluster 2024-01-21T07:47:21.867779+0000 mgr.y (mgr.14140) 414 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:23.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:22 smithi195 bash[13978]: audit 2024-01-21T07:47:22.576085+0000 mgr.y (mgr.14140) 415 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:23.728 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:47:23.728 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:47:23.728 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:47:23.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:47:23.729 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:47:24.113 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:47:24.113 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:47:24.113 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:47:24.113 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:47:24.113 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "" 2024-01-21T07:47:24.114 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:47:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:23 smithi080 bash[13909]: audit 2024-01-21T07:47:22.950184+0000 mgr.y (mgr.14140) 416 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:23 smithi080 bash[13909]: audit 2024-01-21T07:47:23.327353+0000 mgr.y (mgr.14140) 417 : audit [DBG] from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:23 smithi080 bash[13909]: audit 2024-01-21T07:47:23.726715+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.80:0/2743919537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:47:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:23 smithi080 bash[17460]: audit 2024-01-21T07:47:22.950184+0000 mgr.y (mgr.14140) 416 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:23 smithi080 bash[17460]: audit 2024-01-21T07:47:23.327353+0000 mgr.y (mgr.14140) 417 : audit [DBG] from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:23 smithi080 bash[17460]: audit 2024-01-21T07:47:23.726715+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.80:0/2743919537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:47:24.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:23 smithi195 bash[13978]: audit 2024-01-21T07:47:22.950184+0000 mgr.y (mgr.14140) 416 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:24.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:23 smithi195 bash[13978]: audit 2024-01-21T07:47:23.327353+0000 mgr.y (mgr.14140) 417 : audit [DBG] from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:24.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:23 smithi195 bash[13978]: audit 2024-01-21T07:47:23.726715+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.80:0/2743919537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:47:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:24 smithi080 bash[17460]: cluster 2024-01-21T07:47:23.868470+0000 mgr.y (mgr.14140) 418 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:24 smithi080 bash[17460]: audit 2024-01-21T07:47:24.111258+0000 mgr.y (mgr.14140) 419 : audit [DBG] from='client.24688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:24 smithi080 bash[13909]: cluster 2024-01-21T07:47:23.868470+0000 mgr.y (mgr.14140) 418 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:24 smithi080 bash[13909]: audit 2024-01-21T07:47:24.111258+0000 mgr.y (mgr.14140) 419 : audit [DBG] from='client.24688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:25.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:24 smithi195 bash[13978]: cluster 2024-01-21T07:47:23.868470+0000 mgr.y (mgr.14140) 418 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:25.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:24 smithi195 bash[13978]: audit 2024-01-21T07:47:24.111258+0000 mgr.y (mgr.14140) 419 : audit [DBG] from='client.24688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:26 smithi080 bash[13909]: cluster 2024-01-21T07:47:25.869224+0000 mgr.y (mgr.14140) 420 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:27.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:26 smithi080 bash[17460]: cluster 2024-01-21T07:47:25.869224+0000 mgr.y (mgr.14140) 420 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:27.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:26 smithi195 bash[13978]: cluster 2024-01-21T07:47:25.869224+0000 mgr.y (mgr.14140) 420 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:28 smithi080 bash[13909]: cluster 2024-01-21T07:47:27.869948+0000 mgr.y (mgr.14140) 421 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:29.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:28 smithi080 bash[17460]: cluster 2024-01-21T07:47:27.869948+0000 mgr.y (mgr.14140) 421 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:29.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:28 smithi195 bash[13978]: cluster 2024-01-21T07:47:27.869948+0000 mgr.y (mgr.14140) 421 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:30 smithi080 bash[13909]: cluster 2024-01-21T07:47:29.870828+0000 mgr.y (mgr.14140) 422 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:31.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:30 smithi080 bash[17460]: cluster 2024-01-21T07:47:29.870828+0000 mgr.y (mgr.14140) 422 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:31.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:30 smithi195 bash[13978]: cluster 2024-01-21T07:47:29.870828+0000 mgr.y (mgr.14140) 422 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:32 smithi080 bash[13909]: cluster 2024-01-21T07:47:31.871823+0000 mgr.y (mgr.14140) 423 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:33.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:32 smithi080 bash[17460]: cluster 2024-01-21T07:47:31.871823+0000 mgr.y (mgr.14140) 423 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:33.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:32 smithi195 bash[13978]: cluster 2024-01-21T07:47:31.871823+0000 mgr.y (mgr.14140) 423 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:35.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:34 smithi195 bash[13978]: cluster 2024-01-21T07:47:33.872932+0000 mgr.y (mgr.14140) 424 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:35.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:34 smithi080 bash[13909]: cluster 2024-01-21T07:47:33.872932+0000 mgr.y (mgr.14140) 424 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:35.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:34 smithi080 bash[17460]: cluster 2024-01-21T07:47:33.872932+0000 mgr.y (mgr.14140) 424 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:37.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:36 smithi080 bash[13909]: cluster 2024-01-21T07:47:35.874031+0000 mgr.y (mgr.14140) 425 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:37.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:36 smithi080 bash[17460]: cluster 2024-01-21T07:47:35.874031+0000 mgr.y (mgr.14140) 425 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:37.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:36 smithi195 bash[13978]: cluster 2024-01-21T07:47:35.874031+0000 mgr.y (mgr.14140) 425 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:39.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[13909]: cluster 2024-01-21T07:47:37.875124+0000 mgr.y (mgr.14140) 426 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:39.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[13909]: audit 2024-01-21T07:47:38.893271+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_version\": \"ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)\"}"}]: dispatch 2024-01-21T07:47:39.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[13909]: audit 2024-01-21T07:47:38.899177+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_version\": \"ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)\"}"}]': finished 2024-01-21T07:47:39.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[13909]: audit 2024-01-21T07:47:38.900429+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:47:39.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[17460]: cluster 2024-01-21T07:47:37.875124+0000 mgr.y (mgr.14140) 426 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:39.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[17460]: audit 2024-01-21T07:47:38.893271+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_version\": \"ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)\"}"}]: dispatch 2024-01-21T07:47:39.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[17460]: audit 2024-01-21T07:47:38.899177+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_version\": \"ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)\"}"}]': finished 2024-01-21T07:47:39.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:38 smithi080 bash[17460]: audit 2024-01-21T07:47:38.900429+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:47:39.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:38 smithi195 bash[13978]: cluster 2024-01-21T07:47:37.875124+0000 mgr.y (mgr.14140) 426 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:39.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:38 smithi195 bash[13978]: audit 2024-01-21T07:47:38.893271+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_version\": \"ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)\"}"}]: dispatch 2024-01-21T07:47:39.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:38 smithi195 bash[13978]: audit 2024-01-21T07:47:38.899177+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_version\": \"ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)\"}"}]': finished 2024-01-21T07:47:39.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:38 smithi195 bash[13978]: audit 2024-01-21T07:47:38.900429+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:47:40.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[13909]: cephadm 2024-01-21T07:47:38.899987+0000 mgr.y (mgr.14140) 427 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec with id 9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61 2024-01-21T07:47:40.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[13909]: cephadm 2024-01-21T07:47:38.902066+0000 mgr.y (mgr.14140) 428 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-01-21T07:47:40.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[13909]: cephadm 2024-01-21T07:47:38.902806+0000 mgr.y (mgr.14140) 429 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-01-21T07:47:40.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[13909]: cephadm 2024-01-21T07:47:39.153979+0000 mgr.y (mgr.14140) 430 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec on smithi195 2024-01-21T07:47:40.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[17460]: cephadm 2024-01-21T07:47:38.899987+0000 mgr.y (mgr.14140) 427 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec with id 9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61 2024-01-21T07:47:40.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[17460]: cephadm 2024-01-21T07:47:38.902066+0000 mgr.y (mgr.14140) 428 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-01-21T07:47:40.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[17460]: cephadm 2024-01-21T07:47:38.902806+0000 mgr.y (mgr.14140) 429 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-01-21T07:47:40.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:39 smithi080 bash[17460]: cephadm 2024-01-21T07:47:39.153979+0000 mgr.y (mgr.14140) 430 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec on smithi195 2024-01-21T07:47:40.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:39 smithi195 bash[13978]: cephadm 2024-01-21T07:47:38.899987+0000 mgr.y (mgr.14140) 427 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec with id 9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61 2024-01-21T07:47:40.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:39 smithi195 bash[13978]: cephadm 2024-01-21T07:47:38.902066+0000 mgr.y (mgr.14140) 428 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-01-21T07:47:40.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:39 smithi195 bash[13978]: cephadm 2024-01-21T07:47:38.902806+0000 mgr.y (mgr.14140) 429 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-01-21T07:47:40.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:39 smithi195 bash[13978]: cephadm 2024-01-21T07:47:39.153979+0000 mgr.y (mgr.14140) 430 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec on smithi195 2024-01-21T07:47:41.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:40 smithi080 bash[13909]: cluster 2024-01-21T07:47:39.876107+0000 mgr.y (mgr.14140) 431 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:41.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:40 smithi080 bash[17460]: cluster 2024-01-21T07:47:39.876107+0000 mgr.y (mgr.14140) 431 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:41.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:40 smithi195 bash[13978]: cluster 2024-01-21T07:47:39.876107+0000 mgr.y (mgr.14140) 431 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:43.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:42 smithi080 bash[13909]: cluster 2024-01-21T07:47:41.877141+0000 mgr.y (mgr.14140) 432 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:43.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:42 smithi080 bash[17460]: cluster 2024-01-21T07:47:41.877141+0000 mgr.y (mgr.14140) 432 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:43.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:42 smithi195 bash[13978]: cluster 2024-01-21T07:47:41.877141+0000 mgr.y (mgr.14140) 432 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:45.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:44 smithi195 bash[13978]: cluster 2024-01-21T07:47:43.878417+0000 mgr.y (mgr.14140) 433 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:45.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:44 smithi080 bash[13909]: cluster 2024-01-21T07:47:43.878417+0000 mgr.y (mgr.14140) 433 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:45.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:44 smithi080 bash[17460]: cluster 2024-01-21T07:47:43.878417+0000 mgr.y (mgr.14140) 433 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:47.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:46 smithi080 bash[13909]: cluster 2024-01-21T07:47:45.879495+0000 mgr.y (mgr.14140) 434 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:47.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:46 smithi080 bash[17460]: cluster 2024-01-21T07:47:45.879495+0000 mgr.y (mgr.14140) 434 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:47.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:46 smithi195 bash[13978]: cluster 2024-01-21T07:47:45.879495+0000 mgr.y (mgr.14140) 434 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:49.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:48 smithi080 bash[13909]: cluster 2024-01-21T07:47:47.880564+0000 mgr.y (mgr.14140) 435 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:49.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:48 smithi080 bash[17460]: cluster 2024-01-21T07:47:47.880564+0000 mgr.y (mgr.14140) 435 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:49.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:48 smithi195 bash[13978]: cluster 2024-01-21T07:47:47.880564+0000 mgr.y (mgr.14140) 435 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:51.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:50 smithi080 bash[13909]: cluster 2024-01-21T07:47:49.881511+0000 mgr.y (mgr.14140) 436 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:51.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:50 smithi080 bash[17460]: cluster 2024-01-21T07:47:49.881511+0000 mgr.y (mgr.14140) 436 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:51.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:50 smithi195 bash[13978]: cluster 2024-01-21T07:47:49.881511+0000 mgr.y (mgr.14140) 436 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:53.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:52 smithi080 bash[13909]: cluster 2024-01-21T07:47:51.882657+0000 mgr.y (mgr.14140) 437 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:53.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:52 smithi080 bash[17460]: cluster 2024-01-21T07:47:51.882657+0000 mgr.y (mgr.14140) 437 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:53.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:52 smithi195 bash[13978]: cluster 2024-01-21T07:47:51.882657+0000 mgr.y (mgr.14140) 437 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:54.468 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:47:55.104 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (4m) 3m ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d6c769fa64de 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8769f1513fd3 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 3m ago 5m prom/node-exporter 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 3m ago 5m prom/node-exporter 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:47:55.105 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:47:55.106 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:47:55.106 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:47:55.106 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:47:55.106 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:47:55.106 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:47:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:54 smithi195 bash[13978]: cluster 2024-01-21T07:47:53.883804+0000 mgr.y (mgr.14140) 438 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:54 smithi195 bash[13978]: audit 2024-01-21T07:47:54.453073+0000 mgr.y (mgr.14140) 439 : audit [DBG] from='client.24694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:54 smithi195 bash[13978]: audit 2024-01-21T07:47:54.778489+0000 mgr.y (mgr.14140) 440 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:55.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:54 smithi080 bash[13909]: cluster 2024-01-21T07:47:53.883804+0000 mgr.y (mgr.14140) 438 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:55.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:54 smithi080 bash[13909]: audit 2024-01-21T07:47:54.453073+0000 mgr.y (mgr.14140) 439 : audit [DBG] from='client.24694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:55.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:54 smithi080 bash[13909]: audit 2024-01-21T07:47:54.778489+0000 mgr.y (mgr.14140) 440 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:55.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:54 smithi080 bash[17460]: cluster 2024-01-21T07:47:53.883804+0000 mgr.y (mgr.14140) 438 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:55.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:54 smithi080 bash[17460]: audit 2024-01-21T07:47:54.453073+0000 mgr.y (mgr.14140) 439 : audit [DBG] from='client.24694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:55.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:54 smithi080 bash[17460]: audit 2024-01-21T07:47:54.778489+0000 mgr.y (mgr.14140) 440 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:55.448 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:47:55.449 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:47:55.773 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:47:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:47:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:47:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:47:55.773 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "" 2024-01-21T07:47:55.773 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:47:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:55 smithi195 bash[13978]: audit 2024-01-21T07:47:55.097483+0000 mgr.y (mgr.14140) 441 : audit [DBG] from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:55 smithi195 bash[13978]: audit 2024-01-21T07:47:55.446276+0000 mon.a (mon.0) 563 : audit [DBG] from='client.? 172.21.15.80:0/3277390473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:47:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:55 smithi195 bash[13978]: audit 2024-01-21T07:47:55.770433+0000 mgr.y (mgr.14140) 442 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:56.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:55 smithi080 bash[13909]: audit 2024-01-21T07:47:55.097483+0000 mgr.y (mgr.14140) 441 : audit [DBG] from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:56.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:55 smithi080 bash[13909]: audit 2024-01-21T07:47:55.446276+0000 mon.a (mon.0) 563 : audit [DBG] from='client.? 172.21.15.80:0/3277390473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:47:56.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:55 smithi080 bash[13909]: audit 2024-01-21T07:47:55.770433+0000 mgr.y (mgr.14140) 442 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:55 smithi080 bash[17460]: audit 2024-01-21T07:47:55.097483+0000 mgr.y (mgr.14140) 441 : audit [DBG] from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:55 smithi080 bash[17460]: audit 2024-01-21T07:47:55.446276+0000 mon.a (mon.0) 563 : audit [DBG] from='client.? 172.21.15.80:0/3277390473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:47:56.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:55 smithi080 bash[17460]: audit 2024-01-21T07:47:55.770433+0000 mgr.y (mgr.14140) 442 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:47:57.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:56 smithi195 bash[13978]: cluster 2024-01-21T07:47:55.884853+0000 mgr.y (mgr.14140) 443 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:57.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:56 smithi080 bash[13909]: cluster 2024-01-21T07:47:55.884853+0000 mgr.y (mgr.14140) 443 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:57.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:56 smithi080 bash[17460]: cluster 2024-01-21T07:47:55.884853+0000 mgr.y (mgr.14140) 443 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:59.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:47:58 smithi080 bash[13909]: cluster 2024-01-21T07:47:57.885887+0000 mgr.y (mgr.14140) 444 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:59.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:47:58 smithi080 bash[17460]: cluster 2024-01-21T07:47:57.885887+0000 mgr.y (mgr.14140) 444 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:47:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:47:58 smithi195 bash[13978]: cluster 2024-01-21T07:47:57.885887+0000 mgr.y (mgr.14140) 444 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:01.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:00 smithi080 bash[13909]: cluster 2024-01-21T07:47:59.887116+0000 mgr.y (mgr.14140) 445 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:01.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:00 smithi080 bash[17460]: cluster 2024-01-21T07:47:59.887116+0000 mgr.y (mgr.14140) 445 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:01.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:00 smithi195 bash[13978]: cluster 2024-01-21T07:47:59.887116+0000 mgr.y (mgr.14140) 445 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:03.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:02 smithi080 bash[13909]: cluster 2024-01-21T07:48:01.888124+0000 mgr.y (mgr.14140) 446 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:03.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:02 smithi080 bash[17460]: cluster 2024-01-21T07:48:01.888124+0000 mgr.y (mgr.14140) 446 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:03.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:02 smithi195 bash[13978]: cluster 2024-01-21T07:48:01.888124+0000 mgr.y (mgr.14140) 446 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:04 smithi195 bash[13978]: cluster 2024-01-21T07:48:03.889184+0000 mgr.y (mgr.14140) 447 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:05.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:04 smithi080 bash[13909]: cluster 2024-01-21T07:48:03.889184+0000 mgr.y (mgr.14140) 447 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:05.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:04 smithi080 bash[17460]: cluster 2024-01-21T07:48:03.889184+0000 mgr.y (mgr.14140) 447 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:07.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:06 smithi080 bash[13909]: cluster 2024-01-21T07:48:05.890169+0000 mgr.y (mgr.14140) 448 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:07.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:06 smithi080 bash[17460]: cluster 2024-01-21T07:48:05.890169+0000 mgr.y (mgr.14140) 448 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:07.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:06 smithi195 bash[13978]: cluster 2024-01-21T07:48:05.890169+0000 mgr.y (mgr.14140) 448 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:09.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:08 smithi080 bash[13909]: cluster 2024-01-21T07:48:07.891273+0000 mgr.y (mgr.14140) 449 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:09.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:08 smithi080 bash[17460]: cluster 2024-01-21T07:48:07.891273+0000 mgr.y (mgr.14140) 449 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:09.384 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:08 smithi195 bash[13978]: cluster 2024-01-21T07:48:07.891273+0000 mgr.y (mgr.14140) 449 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:11.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:10 smithi080 bash[13909]: cluster 2024-01-21T07:48:09.892260+0000 mgr.y (mgr.14140) 450 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:11.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:10 smithi080 bash[17460]: cluster 2024-01-21T07:48:09.892260+0000 mgr.y (mgr.14140) 450 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:11.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:10 smithi195 bash[13978]: cluster 2024-01-21T07:48:09.892260+0000 mgr.y (mgr.14140) 450 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:13.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:12 smithi080 bash[13909]: cluster 2024-01-21T07:48:11.893262+0000 mgr.y (mgr.14140) 451 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:13.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:12 smithi080 bash[17460]: cluster 2024-01-21T07:48:11.893262+0000 mgr.y (mgr.14140) 451 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:13.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:12 smithi195 bash[13978]: cluster 2024-01-21T07:48:11.893262+0000 mgr.y (mgr.14140) 451 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:15.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:14 smithi195 bash[13978]: cluster 2024-01-21T07:48:13.894365+0000 mgr.y (mgr.14140) 452 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:15.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:14 smithi080 bash[13909]: cluster 2024-01-21T07:48:13.894365+0000 mgr.y (mgr.14140) 452 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:15.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:14 smithi080 bash[17460]: cluster 2024-01-21T07:48:13.894365+0000 mgr.y (mgr.14140) 452 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:17.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:16 smithi080 bash[13909]: cluster 2024-01-21T07:48:15.895279+0000 mgr.y (mgr.14140) 453 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:17.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:16 smithi080 bash[17460]: cluster 2024-01-21T07:48:15.895279+0000 mgr.y (mgr.14140) 453 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:17.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:16 smithi195 bash[13978]: cluster 2024-01-21T07:48:15.895279+0000 mgr.y (mgr.14140) 453 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:19.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:18 smithi080 bash[13909]: cluster 2024-01-21T07:48:17.896296+0000 mgr.y (mgr.14140) 454 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:19.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:18 smithi080 bash[17460]: cluster 2024-01-21T07:48:17.896296+0000 mgr.y (mgr.14140) 454 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:19.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:18 smithi195 bash[13978]: cluster 2024-01-21T07:48:17.896296+0000 mgr.y (mgr.14140) 454 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[13909]: cluster 2024-01-21T07:48:19.897265+0000 mgr.y (mgr.14140) 455 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[13909]: audit 2024-01-21T07:48:20.878526+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[13909]: audit 2024-01-21T07:48:20.886993+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "who": "mgr.x"}]': finished 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[13909]: audit 2024-01-21T07:48:20.888744+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[13909]: audit 2024-01-21T07:48:20.889890+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[13909]: audit 2024-01-21T07:48:20.891391+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[17460]: cluster 2024-01-21T07:48:19.897265+0000 mgr.y (mgr.14140) 455 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[17460]: audit 2024-01-21T07:48:20.878526+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[17460]: audit 2024-01-21T07:48:20.886993+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "who": "mgr.x"}]': finished 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[17460]: audit 2024-01-21T07:48:20.888744+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[17460]: audit 2024-01-21T07:48:20.889890+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:48:21.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:20 smithi080 bash[17460]: audit 2024-01-21T07:48:20.891391+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-01-21T07:48:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:20 smithi195 bash[13978]: cluster 2024-01-21T07:48:19.897265+0000 mgr.y (mgr.14140) 455 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:20 smithi195 bash[13978]: audit 2024-01-21T07:48:20.878526+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:20 smithi195 bash[13978]: audit 2024-01-21T07:48:20.886993+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", "who": "mgr.x"}]': finished 2024-01-21T07:48:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:20 smithi195 bash[13978]: audit 2024-01-21T07:48:20.888744+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-01-21T07:48:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:20 smithi195 bash[13978]: audit 2024-01-21T07:48:20.889890+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:48:21.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:20 smithi195 bash[13978]: audit 2024-01-21T07:48:20.891391+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-01-21T07:48:22.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:21 smithi195 bash[13978]: cephadm 2024-01-21T07:48:20.877716+0000 mgr.y (mgr.14140) 456 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-01-21T07:48:22.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:21 smithi195 bash[13978]: cephadm 2024-01-21T07:48:20.877882+0000 mgr.y (mgr.14140) 457 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-01-21T07:48:22.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:21 smithi195 bash[13978]: cephadm 2024-01-21T07:48:20.890806+0000 mgr.y (mgr.14140) 458 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:48:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:21 smithi080 bash[13909]: cephadm 2024-01-21T07:48:20.877716+0000 mgr.y (mgr.14140) 456 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-01-21T07:48:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:21 smithi080 bash[13909]: cephadm 2024-01-21T07:48:20.877882+0000 mgr.y (mgr.14140) 457 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-01-21T07:48:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:21 smithi080 bash[13909]: cephadm 2024-01-21T07:48:20.890806+0000 mgr.y (mgr.14140) 458 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:48:22.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:21 smithi080 bash[17460]: cephadm 2024-01-21T07:48:20.877716+0000 mgr.y (mgr.14140) 456 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-01-21T07:48:22.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:21 smithi080 bash[17460]: cephadm 2024-01-21T07:48:20.877882+0000 mgr.y (mgr.14140) 457 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-01-21T07:48:22.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:21 smithi080 bash[17460]: cephadm 2024-01-21T07:48:20.890806+0000 mgr.y (mgr.14140) 458 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:48:23.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:22 smithi195 bash[13978]: cluster 2024-01-21T07:48:21.898238+0000 mgr.y (mgr.14140) 459 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:23.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:23 smithi195 systemd[1]: Stopping Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:48:23.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:22 smithi080 bash[13909]: cluster 2024-01-21T07:48:21.898238+0000 mgr.y (mgr.14140) 459 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:23.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:22 smithi080 bash[17460]: cluster 2024-01-21T07:48:21.898238+0000 mgr.y (mgr.14140) 459 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:25.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:24 smithi195 bash[13978]: cluster 2024-01-21T07:48:23.899341+0000 mgr.y (mgr.14140) 460 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:24 smithi080 bash[13909]: cluster 2024-01-21T07:48:23.899341+0000 mgr.y (mgr.14140) 460 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:24 smithi080 bash[17460]: cluster 2024-01-21T07:48:23.899341+0000 mgr.y (mgr.14140) 460 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:26.119 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (5m) 3m ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d6c769fa64de 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8769f1513fd3 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 3m ago 5m prom/node-exporter 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 3m ago 5m prom/node-exporter 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:48:26.756 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:48:26.757 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:48:27.104 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:48:27.106 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:48:27.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:27.106 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:48:27.106 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-01-21T07:48:27.106 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:48:27.106 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:48:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[13909]: cluster 2024-01-21T07:48:25.899974+0000 mgr.y (mgr.14140) 461 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[13909]: audit 2024-01-21T07:48:26.104933+0000 mgr.y (mgr.14140) 462 : audit [DBG] from='client.24724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[13909]: audit 2024-01-21T07:48:26.428119+0000 mgr.y (mgr.14140) 463 : audit [DBG] from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[13909]: audit 2024-01-21T07:48:26.743924+0000 mgr.y (mgr.14140) 464 : audit [DBG] from='client.24736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[17460]: cluster 2024-01-21T07:48:25.899974+0000 mgr.y (mgr.14140) 461 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[17460]: audit 2024-01-21T07:48:26.104933+0000 mgr.y (mgr.14140) 462 : audit [DBG] from='client.24724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[17460]: audit 2024-01-21T07:48:26.428119+0000 mgr.y (mgr.14140) 463 : audit [DBG] from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:26 smithi080 bash[17460]: audit 2024-01-21T07:48:26.743924+0000 mgr.y (mgr.14140) 464 : audit [DBG] from='client.24736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:26 smithi195 bash[13978]: cluster 2024-01-21T07:48:25.899974+0000 mgr.y (mgr.14140) 461 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:27.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:26 smithi195 bash[13978]: audit 2024-01-21T07:48:26.104933+0000 mgr.y (mgr.14140) 462 : audit [DBG] from='client.24724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:26 smithi195 bash[13978]: audit 2024-01-21T07:48:26.428119+0000 mgr.y (mgr.14140) 463 : audit [DBG] from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:26 smithi195 bash[13978]: audit 2024-01-21T07:48:26.743924+0000 mgr.y (mgr.14140) 464 : audit [DBG] from='client.24736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:27.428 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:48:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:48:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:48:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:48:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "" 2024-01-21T07:48:27.428 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:48:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:27 smithi080 bash[13909]: audit 2024-01-21T07:48:27.103005+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.80:0/1030468959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:48:28.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:27 smithi080 bash[13909]: audit 2024-01-21T07:48:27.425683+0000 mgr.y (mgr.14140) 465 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:27 smithi080 bash[17460]: audit 2024-01-21T07:48:27.103005+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.80:0/1030468959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:48:28.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:27 smithi080 bash[17460]: audit 2024-01-21T07:48:27.425683+0000 mgr.y (mgr.14140) 465 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:28.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:27 smithi195 bash[13978]: audit 2024-01-21T07:48:27.103005+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.80:0/1030468959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:48:28.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:27 smithi195 bash[13978]: audit 2024-01-21T07:48:27.425683+0000 mgr.y (mgr.14140) 465 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:28 smithi080 bash[13909]: cluster 2024-01-21T07:48:27.901047+0000 mgr.y (mgr.14140) 466 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:29.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:28 smithi080 bash[17460]: cluster 2024-01-21T07:48:27.901047+0000 mgr.y (mgr.14140) 466 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:29.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:28 smithi195 bash[13978]: cluster 2024-01-21T07:48:27.901047+0000 mgr.y (mgr.14140) 466 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:30 smithi080 bash[13909]: cluster 2024-01-21T07:48:29.902168+0000 mgr.y (mgr.14140) 467 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:31.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:30 smithi080 bash[17460]: cluster 2024-01-21T07:48:29.902168+0000 mgr.y (mgr.14140) 467 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:31.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:30 smithi195 bash[13978]: cluster 2024-01-21T07:48:29.902168+0000 mgr.y (mgr.14140) 467 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:33.244 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:32 smithi195 bash[13978]: cluster 2024-01-21T07:48:31.903213+0000 mgr.y (mgr.14140) 468 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:33.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:32 smithi080 bash[13909]: cluster 2024-01-21T07:48:31.903213+0000 mgr.y (mgr.14140) 468 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:33.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:32 smithi080 bash[17460]: cluster 2024-01-21T07:48:31.903213+0000 mgr.y (mgr.14140) 468 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:34.131 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:33 smithi195 docker[24488]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.x 2024-01-21T07:48:34.131 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:33 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-01-21T07:48:34.131 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:33 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-01-21T07:48:34.131 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:33 smithi195 systemd[1]: Stopped Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:48:34.390 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:34 smithi195 systemd[1]: Starting Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:48:34.390 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:34 smithi195 docker[24570]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.x 2024-01-21T07:48:34.390 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:34 smithi195 systemd[1]: Started Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:48:35.128 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: cluster 2024-01-21T07:48:33.904525+0000 mgr.y (mgr.14140) 469 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:35.129 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[24590]: debug 2024-01-21T07:48:35.120+0000 7fa153902700 1 -- 172.21.15.195:0/1594252575 <== mon.2 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563162c244e0 con 0x563162d18800 2024-01-21T07:48:35.130 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.173301+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:48:35.130 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.179593+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:48:35.130 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.463298+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:48:34.461568\"}"}]: dispatch 2024-01-21T07:48:35.130 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.469416+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:48:34.461568\"}"}]': finished 2024-01-21T07:48:35.130 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.756507+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]: dispatch 2024-01-21T07:48:35.131 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.762815+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]': finished 2024-01-21T07:48:35.131 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:34 smithi195 bash[13978]: audit 2024-01-21T07:48:34.764321+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:48:35.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: cluster 2024-01-21T07:48:33.904525+0000 mgr.y (mgr.14140) 469 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:35.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: cluster 2024-01-21T07:48:33.904525+0000 mgr.y (mgr.14140) 469 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:35.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.173301+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:48:35.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.173301+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]: dispatch 2024-01-21T07:48:35.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.179593+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:48:35.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.179593+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:38:04.779503\"}"}]': finished 2024-01-21T07:48:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.463298+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:48:34.461568\"}"}]: dispatch 2024-01-21T07:48:35.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.463298+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:48:34.461568\"}"}]: dispatch 2024-01-21T07:48:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.469416+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:48:34.461568\"}"}]': finished 2024-01-21T07:48:35.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.469416+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518833\", \"created\": \"2024-01-21T07:36:41.059624\", \"started\": \"2024-01-21T07:36:47.130390\"}, \"mgr.y\": {\"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.518978\", \"created\": \"2024-01-21T07:36:49.387432\", \"started\": \"2024-01-21T07:36:49.414025\"}, \"mon.c\": {\"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519065\", \"created\": \"2024-01-21T07:38:19.897347\", \"started\": \"2024-01-21T07:38:19.917798\"}, \"osd.0\": {\"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519148\", \"created\": \"2024-01-21T07:39:10.808174\", \"started\": \"2024-01-21T07:39:14.034422\"}, \"osd.1\": {\"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519229\", \"created\": \"2024-01-21T07:39:35.335977\", \"started\": \"2024-01-21T07:39:38.855648\"}, \"osd.2\": {\"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519308\", \"created\": \"2024-01-21T07:40:01.095668\", \"started\": \"2024-01-21T07:40:05.102403\"}, \"osd.3\": {\"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519389\", \"created\": \"2024-01-21T07:40:28.143163\", \"started\": \"2024-01-21T07:40:31.788016\"}, \"node-exporter.a\": {\"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:47.519470\", \"created\": \"2024-01-21T07:42:32.004437\"}, \"rgw.r.z.smithi080.bytdbv\": {\"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:47.519519\", \"created\": \"2024-01-21T07:44:46.357524\", \"started\": \"2024-01-21T07:44:46.381778\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480\"}}, \"last_daemon_update\": \"2024-01-21T07:44:47.519700\", \"last_device_update\": \"2024-01-21T07:40:35.201453\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.80\"], \"172.21.15.254\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-01-21T07:48:34.461568\"}"}]': finished 2024-01-21T07:48:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.756507+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]: dispatch 2024-01-21T07:48:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.762815+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]': finished 2024-01-21T07:48:35.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[13909]: audit 2024-01-21T07:48:34.764321+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:48:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.756507+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]: dispatch 2024-01-21T07:48:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.762815+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370015\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370341\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370462\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370602\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370726\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:44:48.370847\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.370920\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:44:48.371041\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]': finished 2024-01-21T07:48:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:34 smithi080 bash[17460]: audit 2024-01-21T07:48:34.764321+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-01-21T07:48:35.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[24590]: debug 2024-01-21T07:48:35.304+0000 7fa163efd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:48:35.866 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[24590]: debug 2024-01-21T07:48:35.408+0000 7fa163efd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:48:36.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[24590]: debug 2024-01-21T07:48:35.896+0000 7fa163efd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:48:36.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[13978]: audit 2024-01-21T07:48:35.776571+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773009\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773207\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:48:34.168926\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773333\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773453\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773571\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773689\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:48:35.773809\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773880\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773999\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:48:35.774251\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]: dispatch 2024-01-21T07:48:36.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[13978]: audit 2024-01-21T07:48:35.783168+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773009\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773207\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:48:34.168926\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773333\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773453\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773571\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773689\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:48:35.773809\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773880\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773999\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:48:35.774251\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]': finished 2024-01-21T07:48:36.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:35 smithi195 bash[13978]: cephadm 2024-01-21T07:48:35.791149+0000 mgr.y (mgr.14140) 470 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:48:36.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:35 smithi080 bash[13909]: audit 2024-01-21T07:48:35.776571+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773009\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773207\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:48:34.168926\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773333\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773453\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773571\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773689\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:48:35.773809\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773880\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773999\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:48:35.774251\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]: dispatch 2024-01-21T07:48:36.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:35 smithi080 bash[13909]: audit 2024-01-21T07:48:35.783168+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773009\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773207\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:48:34.168926\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773333\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773453\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773571\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773689\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:48:35.773809\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773880\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773999\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:48:35.774251\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]': finished 2024-01-21T07:48:36.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:35 smithi080 bash[13909]: cephadm 2024-01-21T07:48:35.791149+0000 mgr.y (mgr.14140) 470 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:48:36.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:35 smithi080 bash[17460]: audit 2024-01-21T07:48:35.776571+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773009\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773207\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:48:34.168926\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773333\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773453\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773571\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773689\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:48:35.773809\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773880\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773999\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:48:35.774251\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]: dispatch 2024-01-21T07:48:36.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:35 smithi080 bash[17460]: audit 2024-01-21T07:48:35.783168+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773009\", \"created\": \"2024-01-21T07:38:35.160135\", \"started\": \"2024-01-21T07:38:35.184331\"}, \"mgr.x\": {\"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773207\", \"created\": \"2024-01-21T07:38:51.927748\", \"started\": \"2024-01-21T07:48:34.168926\"}, \"osd.4\": {\"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773333\", \"created\": \"2024-01-21T07:40:49.926393\", \"started\": \"2024-01-21T07:40:53.317171\"}, \"osd.5\": {\"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773453\", \"created\": \"2024-01-21T07:41:15.313825\", \"started\": \"2024-01-21T07:41:19.117300\"}, \"osd.6\": {\"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773571\", \"created\": \"2024-01-21T07:41:40.993249\", \"started\": \"2024-01-21T07:41:45.403526\"}, \"osd.7\": {\"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773689\", \"created\": \"2024-01-21T07:42:07.484653\", \"started\": \"2024-01-21T07:42:11.022412\"}, \"node-exporter.b\": {\"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2024-01-21T07:48:35.773809\", \"created\": \"2024-01-21T07:42:32.704085\"}, \"grafana.a\": {\"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773880\", \"created\": \"2024-01-21T07:43:14.171149\", \"started\": \"2024-01-21T07:43:14.193871\"}, \"rgw.r.z.smithi195.uawmcm\": {\"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-01-21T07:48:35.773999\", \"created\": \"2024-01-21T07:44:43.829184\", \"started\": \"2024-01-21T07:44:43.848752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511\"}}, \"last_daemon_update\": \"2024-01-21T07:48:35.774251\", \"last_device_update\": \"2024-01-21T07:42:14.728522\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"172.21.15.254\": [\"172.21.15.195\"]}, \"last_host_check\": \"2024-01-21T07:48:34.754419\"}"}]': finished 2024-01-21T07:48:36.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:35 smithi080 bash[17460]: cephadm 2024-01-21T07:48:35.791149+0000 mgr.y (mgr.14140) 470 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:48:37.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:36 smithi195 bash[13978]: cluster 2024-01-21T07:48:35.905538+0000 mgr.y (mgr.14140) 471 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:37.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:36 smithi195 bash[24590]: debug 2024-01-21T07:48:36.808+0000 7fa163efd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:48:37.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:36 smithi195 bash[24590]: debug 2024-01-21T07:48:36.904+0000 7fa163efd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:48:37.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:36 smithi080 bash[13909]: cluster 2024-01-21T07:48:35.905538+0000 mgr.y (mgr.14140) 471 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:37.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:36 smithi080 bash[17460]: cluster 2024-01-21T07:48:35.905538+0000 mgr.y (mgr.14140) 471 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:37.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:37 smithi195 bash[24590]: debug 2024-01-21T07:48:37.144+0000 7fa163efd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:48:38.523 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:38 smithi195 bash[24590]: debug 2024-01-21T07:48:38.260+0000 7fa163efd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:48:38.523 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:38 smithi195 bash[24590]: debug 2024-01-21T07:48:38.419+0000 7fa163efd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:48:38.851 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:38 smithi195 bash[24590]: debug 2024-01-21T07:48:38.515+0000 7fa163efd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:48:38.852 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:38 smithi195 bash[24590]: debug 2024-01-21T07:48:38.623+0000 7fa163efd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:48:38.852 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:38 smithi195 bash[24590]: debug 2024-01-21T07:48:38.843+0000 7fa163efd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:48:39.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:38 smithi195 bash[13978]: cluster 2024-01-21T07:48:37.906590+0000 mgr.y (mgr.14140) 472 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:39.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:38 smithi080 bash[13909]: cluster 2024-01-21T07:48:37.906590+0000 mgr.y (mgr.14140) 472 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:39.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:38 smithi080 bash[17460]: cluster 2024-01-21T07:48:37.906590+0000 mgr.y (mgr.14140) 472 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:39.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[24590]: debug 2024-01-21T07:48:39.207+0000 7fa163efd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:48:39.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[24590]: debug 2024-01-21T07:48:39.327+0000 7fa163efd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: cephadm 2024-01-21T07:48:39.787108+0000 mgr.y (mgr.14140) 473 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.061 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: debug 2024-01-21T07:48:39.784+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:48:40.062 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.063 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: cephadm 2024-01-21T07:48:39.787108+0000 mgr.y (mgr.14140) 473 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.064 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.065 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:48:40.066 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: cephadm 2024-01-21T07:48:39.787414+0000 mgr.y (mgr.14140) 474 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.067 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[13909]: cephadm 2024-01-21T07:48:39.794076+0000 mgr.y (mgr.14140) 475 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: cephadm 2024-01-21T07:48:39.787414+0000 mgr.y (mgr.14140) 474 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:40.068 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.069 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:39 smithi080 bash[17460]: cephadm 2024-01-21T07:48:39.794076+0000 mgr.y (mgr.14140) 475 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:48:40.302 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:40 smithi195 bash[24590]: debug 2024-01-21T07:48:40.191+0000 7fa163efd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:48:40.302 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:40 smithi195 bash[24590]: debug 2024-01-21T07:48:40.295+0000 7fa163efd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: cephadm 2024-01-21T07:48:39.787108+0000 mgr.y (mgr.14140) 473 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.303 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:48:40.304 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: cephadm 2024-01-21T07:48:39.787414+0000 mgr.y (mgr.14140) 474 : cephadm [WRN] Failed to apply prometheus spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi195', network='', name='a')]), 'service_type': 'prometheus', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:Verifying port 9095 ... 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/prometheus:latest' locally 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:40.305 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 2448, in extract_uid_gid_monitoring 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/prometheus:latest -e NODE_NAME=smithi195 --entrypoint stat prom/prometheus:latest -c %u %g /etc/prometheus 2024-01-21T07:48:40.306 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:39 smithi195 bash[13978]: cephadm 2024-01-21T07:48:39.794076+0000 mgr.y (mgr.14140) 475 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:48:40.634 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:40 smithi195 bash[24590]: debug 2024-01-21T07:48:40.407+0000 7fa163efd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:48:40.888 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:40 smithi195 bash[24590]: debug 2024-01-21T07:48:40.627+0000 7fa163efd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:48:41.256 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:40 smithi195 bash[13978]: cluster 2024-01-21T07:48:39.907526+0000 mgr.y (mgr.14140) 476 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:41.256 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:40 smithi195 bash[24590]: debug 2024-01-21T07:48:40.915+0000 7fa163efd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:48:41.256 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[24590]: debug 2024-01-21T07:48:41.079+0000 7fa163efd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:48:41.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:40 smithi080 bash[13909]: cluster 2024-01-21T07:48:39.907526+0000 mgr.y (mgr.14140) 476 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:41.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:40 smithi080 bash[17460]: cluster 2024-01-21T07:48:39.907526+0000 mgr.y (mgr.14140) 476 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:41.571 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[24590]: debug 2024-01-21T07:48:41.247+0000 7fa163efd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:48:41.571 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[24590]: debug 2024-01-21T07:48:41.459+0000 7fa163efd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:48:41.888 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[24590]: debug 2024-01-21T07:48:41.563+0000 7fa163efd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:48:42.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[13909]: cluster 2024-01-21T07:48:41.592163+0000 mon.a (mon.0) 578 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:48:42.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[13909]: cluster 2024-01-21T07:48:41.592363+0000 mon.a (mon.0) 579 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:48:42.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[13909]: audit 2024-01-21T07:48:41.593496+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:48:42.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[13909]: audit 2024-01-21T07:48:41.594525+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[13909]: audit 2024-01-21T07:48:41.596575+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[13909]: audit 2024-01-21T07:48:41.597267+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[17460]: cluster 2024-01-21T07:48:41.592163+0000 mon.a (mon.0) 578 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[17460]: cluster 2024-01-21T07:48:41.592363+0000 mon.a (mon.0) 579 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[17460]: audit 2024-01-21T07:48:41.593496+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[17460]: audit 2024-01-21T07:48:41.594525+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[17460]: audit 2024-01-21T07:48:41.596575+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:48:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:41 smithi080 bash[17460]: audit 2024-01-21T07:48:41.597267+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:42.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[13978]: cluster 2024-01-21T07:48:41.592163+0000 mon.a (mon.0) 578 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:48:42.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[13978]: cluster 2024-01-21T07:48:41.592363+0000 mon.a (mon.0) 579 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:48:42.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[13978]: audit 2024-01-21T07:48:41.593496+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:48:42.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[13978]: audit 2024-01-21T07:48:41.594525+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:42.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[13978]: audit 2024-01-21T07:48:41.596575+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:48:42.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:41 smithi195 bash[13978]: audit 2024-01-21T07:48:41.597267+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:43.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:42 smithi080 bash[13909]: cluster 2024-01-21T07:48:41.908639+0000 mgr.y (mgr.14140) 477 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:43.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[13909]: cluster 2024-01-21T07:48:42.005538+0000 mon.a (mon.0) 580 : cluster [DBG] mgrmap e15: y(active, since 11m), standbys: x 2024-01-21T07:48:43.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[17460]: cluster 2024-01-21T07:48:41.908639+0000 mgr.y (mgr.14140) 477 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:43.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[17460]: cluster 2024-01-21T07:48:42.005538+0000 mon.a (mon.0) 580 : cluster [DBG] mgrmap e15: y(active, since 11m), standbys: x 2024-01-21T07:48:43.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:43 smithi195 bash[13978]: cluster 2024-01-21T07:48:41.908639+0000 mgr.y (mgr.14140) 477 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:43.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:43 smithi195 bash[13978]: cluster 2024-01-21T07:48:42.005538+0000 mon.a (mon.0) 580 : cluster [DBG] mgrmap e15: y(active, since 11m), standbys: x 2024-01-21T07:48:44.007 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: debug 2024-01-21T07:48:43.800+0000 7f202ee6e700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:48:44.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: code, '\n'.join(err))) 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: Traceback (most recent call last): 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 4247, in 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 968, in _default_image 2024-01-21T07:48:44.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 1973, in run 2024-01-21T07:48:44.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: File "", line 696, in call_throws 2024-01-21T07:48:44.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:43 smithi080 bash[14168]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[14168]: debug 2024-01-21T07:48:44.012+0000 7f2054ab0700 -1 mgr handle_mgr_map I was active but no longer am 2024-01-21T07:48:44.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[14168]: ignoring --setuser ceph since I am not root 2024-01-21T07:48:44.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[14168]: ignoring --setgroup ceph since I am not root 2024-01-21T07:48:44.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[14168]: debug 2024-01-21T07:48:44.056+0000 7fc024a3f040 1 -- 172.21.15.80:0/148977507 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604c2687000 msgr2=0x5604c32fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T07:48:44.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[14168]: debug 2024-01-21T07:48:44.056+0000 7fc024a3f040 1 --2- 172.21.15.80:0/148977507 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x5604c2687000 0x5604c32fc480 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x5604c2679110 tx=0x5604c267b7c0).stop 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cephadm 2024-01-21T07:48:43.805062+0000 mgr.y (mgr.14140) 478 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: code, '\n'.join(err))) 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:48:44.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cephadm 2024-01-21T07:48:43.805062+0000 mgr.y (mgr.14140) 478 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: code, '\n'.join(err))) 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cephadm 2024-01-21T07:48:43.805229+0000 mgr.y (mgr.14140) 479 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: Traceback (most recent call last): 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 4247, in 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 968, in _default_image 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 1973, in run 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: File "", line 696, in call_throws 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cephadm 2024-01-21T07:48:43.806663+0000 mgr.y (mgr.14140) 480 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec with id 9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: audit 2024-01-21T07:48:43.807366+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cephadm 2024-01-21T07:48:43.809510+0000 mgr.y (mgr.14140) 481 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cephadm 2024-01-21T07:48:43.810531+0000 mgr.y (mgr.14140) 482 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cephadm 2024-01-21T07:48:43.815845+0000 mgr.y (mgr.14140) 483 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: audit 2024-01-21T07:48:43.816909+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cluster 2024-01-21T07:48:43.825528+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[17460]: cluster 2024-01-21T07:48:43.876035+0000 mon.a (mon.0) 584 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cephadm 2024-01-21T07:48:43.805229+0000 mgr.y (mgr.14140) 479 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: Traceback (most recent call last): 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 4247, in 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 968, in _default_image 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 1973, in run 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: File "", line 696, in call_throws 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cephadm 2024-01-21T07:48:43.806663+0000 mgr.y (mgr.14140) 480 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec with id 9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: audit 2024-01-21T07:48:43.807366+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:44.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cephadm 2024-01-21T07:48:43.809510+0000 mgr.y (mgr.14140) 481 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-01-21T07:48:44.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cephadm 2024-01-21T07:48:43.810531+0000 mgr.y (mgr.14140) 482 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-01-21T07:48:44.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cephadm 2024-01-21T07:48:43.815845+0000 mgr.y (mgr.14140) 483 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-01-21T07:48:44.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: audit 2024-01-21T07:48:43.816909+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-01-21T07:48:44.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cluster 2024-01-21T07:48:43.825528+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-01-21T07:48:44.318 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:44 smithi080 bash[13909]: cluster 2024-01-21T07:48:43.876035+0000 mon.a (mon.0) 584 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cephadm 2024-01-21T07:48:43.805062+0000 mgr.y (mgr.14140) 478 : cephadm [ERR] cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:48:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1613, in _run_cephadm 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: code, '\n'.join(err))) 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: RuntimeError: cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:48:44.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cephadm 2024-01-21T07:48:43.805229+0000 mgr.y (mgr.14140) 479 : cephadm [WRN] Failed to apply alertmanager spec ServiceSpec({'placement': PlacementSpec(count=1, hosts=[HostPlacementSpec(hostname='smithi080', network='', name='a')]), 'service_type': 'alertmanager', 'service_id': None, 'unmanaged': False}): cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon alertmanager.a ... 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Verifying port 9093 ... 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Verifying port 9094 ... 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:Non-zero exit code 125 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr Unable to find image 'prom/alertmanager:latest' locally 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit. 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: INFO:cephadm:stat:stderr See 'docker run --help'. 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: Traceback (most recent call last): 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 4247, in 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 968, in _default_image 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 2508, in command_deploy 2024-01-21T07:48:44.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 2454, in extract_uid_gid_monitoring 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 1532, in extract_uid_gid 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 1973, in run 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: File "", line 696, in call_throws 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=prom/alertmanager -e NODE_NAME=smithi080 --entrypoint stat prom/alertmanager -c %u %g /etc/alertmanager 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cephadm 2024-01-21T07:48:43.806663+0000 mgr.y (mgr.14140) 480 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec with id 9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: audit 2024-01-21T07:48:43.807366+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cephadm 2024-01-21T07:48:43.809510+0000 mgr.y (mgr.14140) 481 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cephadm 2024-01-21T07:48:43.810531+0000 mgr.y (mgr.14140) 482 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cephadm 2024-01-21T07:48:43.815845+0000 mgr.y (mgr.14140) 483 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: audit 2024-01-21T07:48:43.816909+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cluster 2024-01-21T07:48:43.825528+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-01-21T07:48:44.393 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:44 smithi195 bash[13978]: cluster 2024-01-21T07:48:43.876035+0000 mon.a (mon.0) 584 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:48:45.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:45 smithi080 bash[13909]: audit 2024-01-21T07:48:44.021043+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-01-21T07:48:45.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:45 smithi080 bash[13909]: cluster 2024-01-21T07:48:44.021103+0000 mon.a (mon.0) 586 : cluster [DBG] mgrmap e16: x(active, starting, since 0.203117s), standbys: y 2024-01-21T07:48:45.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:45 smithi080 bash[17460]: audit 2024-01-21T07:48:44.021043+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-01-21T07:48:45.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:45 smithi080 bash[17460]: cluster 2024-01-21T07:48:44.021103+0000 mon.a (mon.0) 586 : cluster [DBG] mgrmap e16: x(active, starting, since 0.203117s), standbys: y 2024-01-21T07:48:45.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:45 smithi195 bash[13978]: audit 2024-01-21T07:48:44.021043+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.80:0/2431845299' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-01-21T07:48:45.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:45 smithi195 bash[13978]: cluster 2024-01-21T07:48:44.021103+0000 mon.a (mon.0) 586 : cluster [DBG] mgrmap e16: x(active, starting, since 0.203117s), standbys: y 2024-01-21T07:48:47.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:47 smithi080 bash[17460]: cluster 2024-01-21T07:48:46.032914+0000 mon.a (mon.0) 587 : cluster [DBG] mgrmap e17: x(active, starting, since 2s), standbys: y 2024-01-21T07:48:47.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:47 smithi080 bash[17460]: audit 2024-01-21T07:48:46.034094+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:48:47.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:47 smithi080 bash[17460]: audit 2024-01-21T07:48:46.034434+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:48:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:47 smithi080 bash[13909]: cluster 2024-01-21T07:48:46.032914+0000 mon.a (mon.0) 587 : cluster [DBG] mgrmap e17: x(active, starting, since 2s), standbys: y 2024-01-21T07:48:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:47 smithi080 bash[13909]: audit 2024-01-21T07:48:46.034094+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:48:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:47 smithi080 bash[13909]: audit 2024-01-21T07:48:46.034434+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:48:47.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:47 smithi195 bash[13978]: cluster 2024-01-21T07:48:46.032914+0000 mon.a (mon.0) 587 : cluster [DBG] mgrmap e17: x(active, starting, since 2s), standbys: y 2024-01-21T07:48:47.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:47 smithi195 bash[13978]: audit 2024-01-21T07:48:46.034094+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:48:47.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:47 smithi195 bash[13978]: audit 2024-01-21T07:48:46.034434+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:48:48.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:48 smithi195 bash[13978]: cluster 2024-01-21T07:48:48.284383+0000 mon.a (mon.0) 588 : cluster [DBG] Standby manager daemon y restarted 2024-01-21T07:48:48.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:48 smithi195 bash[13978]: cluster 2024-01-21T07:48:48.284632+0000 mon.a (mon.0) 589 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:48:48.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:48 smithi195 bash[13978]: audit 2024-01-21T07:48:48.286711+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.? 172.21.15.80:0/2955152075' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:48.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:48 smithi195 bash[13978]: audit 2024-01-21T07:48:48.289457+0000 mon.a (mon.0) 591 : audit [DBG] from='mgr.? 172.21.15.80:0/2955152075' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:48.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[13909]: cluster 2024-01-21T07:48:48.284383+0000 mon.a (mon.0) 588 : cluster [DBG] Standby manager daemon y restarted 2024-01-21T07:48:48.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[13909]: cluster 2024-01-21T07:48:48.284632+0000 mon.a (mon.0) 589 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:48:48.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[13909]: audit 2024-01-21T07:48:48.286711+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.? 172.21.15.80:0/2955152075' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:48.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[13909]: audit 2024-01-21T07:48:48.289457+0000 mon.a (mon.0) 591 : audit [DBG] from='mgr.? 172.21.15.80:0/2955152075' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:48.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[17460]: cluster 2024-01-21T07:48:48.284383+0000 mon.a (mon.0) 588 : cluster [DBG] Standby manager daemon y restarted 2024-01-21T07:48:48.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[17460]: cluster 2024-01-21T07:48:48.284632+0000 mon.a (mon.0) 589 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:48:48.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[17460]: audit 2024-01-21T07:48:48.286711+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.? 172.21.15.80:0/2955152075' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:48.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:48 smithi080 bash[17460]: audit 2024-01-21T07:48:48.289457+0000 mon.a (mon.0) 591 : audit [DBG] from='mgr.? 172.21.15.80:0/2955152075' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:49.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:49 smithi195 bash[13978]: cluster 2024-01-21T07:48:48.343786+0000 mon.a (mon.0) 592 : cluster [DBG] mgrmap e18: x(active, starting, since 4s), standbys: y 2024-01-21T07:48:49.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:49 smithi080 bash[13909]: cluster 2024-01-21T07:48:48.343786+0000 mon.a (mon.0) 592 : cluster [DBG] mgrmap e18: x(active, starting, since 4s), standbys: y 2024-01-21T07:48:49.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:49 smithi080 bash[17460]: cluster 2024-01-21T07:48:48.343786+0000 mon.a (mon.0) 592 : cluster [DBG] mgrmap e18: x(active, starting, since 4s), standbys: y 2024-01-21T07:48:50.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.026060+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.026354+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.026624+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.030790+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.031202+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.031582+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.032000+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.032343+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.032706+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.033063+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.033407+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:48:50.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.035858+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.036169+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.036945+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.038616+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.039845+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.040365+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.040859+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.026060+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.026354+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.026624+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.030790+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:48:50.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.031202+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.031582+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.032000+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.032343+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.032706+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.033063+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.033407+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.035858+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.036169+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.036945+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.038616+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.039845+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.040365+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:48:50.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.040859+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.041366+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.041854+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.042328+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.042827+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.043344+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.043866+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.044360+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.044885+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.045365+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.045872+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.046356+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.046926+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:48:50.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.047486+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.048038+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.048611+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.049175+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.041366+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.041854+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.042328+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.042827+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.043344+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.043866+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.044360+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:48:50.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.044885+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.045365+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.045872+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.046356+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.046926+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.047486+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.048038+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.048611+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.049175+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.049709+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:48:50.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.050203+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: cluster 2024-01-21T07:48:50.070377+0000 mon.a (mon.0) 593 : cluster [INF] Manager daemon x is now available 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: cephadm 2024-01-21T07:48:50.086773+0000 mgr.x (mgr.34730) 1 : cephadm [INF] inventory: adjusted host smithi080 addr 'smithi080' -> '172.21.15.80' 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.087623+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.089583+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.095205+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: cephadm 2024-01-21T07:48:50.102239+0000 mgr.x (mgr.34730) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.102723+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.104911+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.109519+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.233248+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.235467+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-01-21T07:48:50.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.049709+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.050203+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: cluster 2024-01-21T07:48:50.070377+0000 mon.a (mon.0) 593 : cluster [INF] Manager daemon x is now available 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: cephadm 2024-01-21T07:48:50.086773+0000 mgr.x (mgr.34730) 1 : cephadm [INF] inventory: adjusted host smithi080 addr 'smithi080' -> '172.21.15.80' 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.087623+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.089583+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.095205+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: cephadm 2024-01-21T07:48:50.102239+0000 mgr.x (mgr.34730) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.102723+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.104911+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.109519+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.233248+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-01-21T07:48:50.566 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.235467+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.241018+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.242655+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.245434+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.307262+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.309299+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.314354+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[13909]: audit 2024-01-21T07:48:50.316320+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.241018+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.242655+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.245434+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.307262+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:48:50.567 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.309299+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:48:50.568 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.314354+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:48:50.568 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:50 smithi080 bash[17460]: audit 2024-01-21T07:48:50.316320+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:48:50.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[24590]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.026060+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.026354+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.026624+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.030790+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.031202+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.031582+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.032000+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.032343+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.032706+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.033063+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.033407+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.035858+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:48:50.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.036169+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.036945+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.038616+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.039845+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.040365+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.040859+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.041366+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.041854+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.042328+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.042827+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.043344+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.043866+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.044360+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:48:50.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.044885+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.045365+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.045872+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.046356+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.046926+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.047486+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.048038+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.048611+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.049175+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:48:50.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.049709+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.050203+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: cluster 2024-01-21T07:48:50.070377+0000 mon.a (mon.0) 593 : cluster [INF] Manager daemon x is now available 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: cephadm 2024-01-21T07:48:50.086773+0000 mgr.x (mgr.34730) 1 : cephadm [INF] inventory: adjusted host smithi080 addr 'smithi080' -> '172.21.15.80' 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.087623+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.089583+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.095205+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: cephadm 2024-01-21T07:48:50.102239+0000 mgr.x (mgr.34730) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.102723+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.104911+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.109519+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.233248+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.235467+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-01-21T07:48:50.642 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.241018+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-01-21T07:48:50.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.242655+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:50.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.245434+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:48:50.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.307262+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:48:50.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.309299+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:48:50.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.314354+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:48:50.643 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:50 smithi195 bash[13978]: audit 2024-01-21T07:48:50.316320+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:48:51.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:51 smithi080 bash[13909]: cluster 2024-01-21T07:48:50.373026+0000 mon.a (mon.0) 602 : cluster [DBG] mgrmap e19: x(active, since 6s), standbys: y 2024-01-21T07:48:51.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:51 smithi080 bash[13909]: cluster 2024-01-21T07:48:50.404673+0000 mgr.x (mgr.34730) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:51.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:51 smithi080 bash[17460]: cluster 2024-01-21T07:48:50.373026+0000 mon.a (mon.0) 602 : cluster [DBG] mgrmap e19: x(active, since 6s), standbys: y 2024-01-21T07:48:51.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:51 smithi080 bash[17460]: cluster 2024-01-21T07:48:50.404673+0000 mgr.x (mgr.34730) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:51.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:51 smithi195 bash[13978]: cluster 2024-01-21T07:48:50.373026+0000 mon.a (mon.0) 602 : cluster [DBG] mgrmap e19: x(active, since 6s), standbys: y 2024-01-21T07:48:51.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:51 smithi195 bash[13978]: cluster 2024-01-21T07:48:50.404673+0000 mgr.x (mgr.34730) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:52.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:52 smithi080 bash[13909]: cluster 2024-01-21T07:48:52.036205+0000 mgr.x (mgr.34730) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:52.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:52 smithi080 bash[17460]: cluster 2024-01-21T07:48:52.036205+0000 mgr.x (mgr.34730) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:52.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:52 smithi195 bash[13978]: cluster 2024-01-21T07:48:52.036205+0000 mgr.x (mgr.34730) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:53.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:53 smithi080 bash[13909]: cluster 2024-01-21T07:48:52.405520+0000 mon.a (mon.0) 603 : cluster [DBG] mgrmap e20: x(active, since 8s), standbys: y 2024-01-21T07:48:53.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:53 smithi080 bash[17460]: cluster 2024-01-21T07:48:52.405520+0000 mon.a (mon.0) 603 : cluster [DBG] mgrmap e20: x(active, since 8s), standbys: y 2024-01-21T07:48:53.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:53 smithi195 bash[13978]: cluster 2024-01-21T07:48:52.405520+0000 mon.a (mon.0) 603 : cluster [DBG] mgrmap e20: x(active, since 8s), standbys: y 2024-01-21T07:48:55.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:54 smithi195 bash[13978]: cluster 2024-01-21T07:48:54.036931+0000 mgr.x (mgr.34730) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:55.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:54 smithi080 bash[13909]: cluster 2024-01-21T07:48:54.036931+0000 mgr.x (mgr.34730) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:55.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:54 smithi080 bash[17460]: cluster 2024-01-21T07:48:54.036931+0000 mgr.x (mgr.34730) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:57.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:57 smithi195 bash[13978]: cluster 2024-01-21T07:48:56.038410+0000 mgr.x (mgr.34730) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:57.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:57 smithi080 bash[13909]: cluster 2024-01-21T07:48:56.038410+0000 mgr.x (mgr.34730) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:57.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:57 smithi080 bash[17460]: cluster 2024-01-21T07:48:56.038410+0000 mgr.x (mgr.34730) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:57.815 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:48:58.566 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (5m) 22s ago 5m - - 6.6.2 87a51ecf0b1c d6c769fa64de 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (24s) 22s ago 10m - - 16.2.14-454-gea310589 9b28eb2d7c37 82dc6695abd6 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (12m) 4m ago 12m - - 15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (12m) 4m ago 12m - 2048M 15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (10m) 22s ago 10m - 2048M 15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (10m) 4m ago 10m - 2048M 15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 4m ago 6m - - 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 22s ago 6m - - 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (9m) 4m ago 9m - 4096M 15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (9m) 4m ago 9m - 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (8m) 4m ago 8m - 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (8m) 4m ago 8m - 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (8m) 22s ago 8m - 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:48:58.567 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (7m) 22s ago 7m - 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:48:58.568 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (7m) 22s ago 7m - 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:48:58.568 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (6m) 22s ago 6m - 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:48:58.568 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (4m) 4m ago 4m - - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:48:58.568 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (4m) 22s ago 4m - - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:48:58.998 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:48:58.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:48:59.000 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:48:59.000 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-01-21T07:48:59.000 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:48:59.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:48:59.000 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "which": "Upgrading all daemon types on all hosts", 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "progress": "", 2024-01-21T07:48:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "", 2024-01-21T07:48:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "is_paused": false 2024-01-21T07:48:59.370 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:48:59.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[24590]: Warning: Permanently added 'smithi195,172.21.15.195' (ECDSA) to the list of known hosts. 2024-01-21T07:48:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:57.796919+0000 mgr.x (mgr.34730) 7 : audit [DBG] from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: cluster 2024-01-21T07:48:58.039107+0000 mgr.x (mgr.34730) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.541584+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.542635+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.543675+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.544660+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.545619+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.546562+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.551788+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.552682+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.553395+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.554064+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.554699+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.935367+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.937595+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.945212+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.947067+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.948911+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.955521+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]': finished 2024-01-21T07:48:59.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.959677+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:48:59.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:48:59 smithi195 bash[13978]: audit 2024-01-21T07:48:58.996950+0000 mon.a (mon.0) 608 : audit [DBG] from='client.? 172.21.15.80:0/3939813208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:57.796919+0000 mgr.x (mgr.34730) 7 : audit [DBG] from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: cluster 2024-01-21T07:48:58.039107+0000 mgr.x (mgr.34730) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.541584+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.542635+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.543675+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.544660+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.545619+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.546562+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.551788+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.552682+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.553395+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.554064+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.554699+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.935367+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.937595+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.945212+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.947067+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.948911+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.955521+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]': finished 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.959677+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[13909]: audit 2024-01-21T07:48:58.996950+0000 mon.a (mon.0) 608 : audit [DBG] from='client.? 172.21.15.80:0/3939813208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:57.796919+0000 mgr.x (mgr.34730) 7 : audit [DBG] from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:48:59.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: cluster 2024-01-21T07:48:58.039107+0000 mgr.x (mgr.34730) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.541584+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.542635+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.543675+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.544660+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.545619+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.546562+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.551788+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.552682+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.553395+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.554064+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.554699+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.935367+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.937595+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.945212+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2024-01-21T07:48:59.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.947067+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:59.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.948911+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]: dispatch 2024-01-21T07:48:59.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.955521+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.x"}]': finished 2024-01-21T07:48:59.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.959677+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:48:59.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:48:59 smithi080 bash[17460]: audit 2024-01-21T07:48:58.996950+0000 mon.a (mon.0) 608 : audit [DBG] from='client.? 172.21.15.80:0/3939813208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:49:00.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:00 smithi195 bash[13978]: audit 2024-01-21T07:48:58.173011+0000 mgr.x (mgr.34730) 9 : audit [DBG] from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:00.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:00 smithi195 bash[13978]: audit 2024-01-21T07:48:58.536147+0000 mgr.x (mgr.34730) 10 : audit [DBG] from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:00.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:00 smithi195 bash[13978]: audit 2024-01-21T07:48:59.294637+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:00.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:00 smithi080 bash[13909]: audit 2024-01-21T07:48:58.173011+0000 mgr.x (mgr.34730) 9 : audit [DBG] from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:00.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:00 smithi080 bash[13909]: audit 2024-01-21T07:48:58.536147+0000 mgr.x (mgr.34730) 10 : audit [DBG] from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:00.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:00 smithi080 bash[13909]: audit 2024-01-21T07:48:59.294637+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:00.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:00 smithi080 bash[17460]: audit 2024-01-21T07:48:58.173011+0000 mgr.x (mgr.34730) 9 : audit [DBG] from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:00.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:00 smithi080 bash[17460]: audit 2024-01-21T07:48:58.536147+0000 mgr.x (mgr.34730) 10 : audit [DBG] from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:00.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:00 smithi080 bash[17460]: audit 2024-01-21T07:48:59.294637+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:01.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:01 smithi195 bash[13978]: audit 2024-01-21T07:48:59.364571+0000 mgr.x (mgr.34730) 11 : audit [DBG] from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:01.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:01 smithi195 bash[13978]: cluster 2024-01-21T07:49:00.039737+0000 mgr.x (mgr.34730) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:01.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:01 smithi080 bash[13909]: audit 2024-01-21T07:48:59.364571+0000 mgr.x (mgr.34730) 11 : audit [DBG] from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:01.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:01 smithi080 bash[13909]: cluster 2024-01-21T07:49:00.039737+0000 mgr.x (mgr.34730) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:01.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:01 smithi080 bash[17460]: audit 2024-01-21T07:48:59.364571+0000 mgr.x (mgr.34730) 11 : audit [DBG] from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:01.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:01 smithi080 bash[17460]: cluster 2024-01-21T07:49:00.039737+0000 mgr.x (mgr.34730) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:03.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:03 smithi195 bash[13978]: cluster 2024-01-21T07:49:02.041284+0000 mgr.x (mgr.34730) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:03.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:03 smithi080 bash[13909]: cluster 2024-01-21T07:49:02.041284+0000 mgr.x (mgr.34730) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:03.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:03 smithi080 bash[17460]: cluster 2024-01-21T07:49:02.041284+0000 mgr.x (mgr.34730) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:05.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:04 smithi195 bash[13978]: cluster 2024-01-21T07:49:04.041995+0000 mgr.x (mgr.34730) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:04 smithi195 bash[13978]: audit 2024-01-21T07:49:04.685519+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:04 smithi195 bash[13978]: audit 2024-01-21T07:49:04.688300+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:05.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:04 smithi195 bash[13978]: audit 2024-01-21T07:49:04.693825+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:05.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[13909]: cluster 2024-01-21T07:49:04.041995+0000 mgr.x (mgr.34730) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:05.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[17460]: cluster 2024-01-21T07:49:04.041995+0000 mgr.x (mgr.34730) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:05.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[13909]: audit 2024-01-21T07:49:04.685519+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:05.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[17460]: audit 2024-01-21T07:49:04.685519+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[17460]: audit 2024-01-21T07:49:04.688300+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[17460]: audit 2024-01-21T07:49:04.693825+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:05.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[13909]: audit 2024-01-21T07:49:04.688300+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:05.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:04 smithi080 bash[13909]: audit 2024-01-21T07:49:04.693825+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:04.683369Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.990244+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.991022+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.991630+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.992182+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.992763+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.993379+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.993892+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.994393+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:05 smithi195 bash[13978]: audit 2024-01-21T07:49:04.994913+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.990244+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.991022+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.991630+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.992182+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.992763+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.993379+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.993892+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.994393+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[13909]: audit 2024-01-21T07:49:04.994913+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.990244+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.991022+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.991630+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.992182+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.992763+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.993379+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.993892+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:06.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.994393+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:06.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:05 smithi080 bash[17460]: audit 2024-01-21T07:49:04.994913+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:05.862795+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:05.866026+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:05.880267+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: cluster 2024-01-21T07:49:06.043400+0000 mgr.x (mgr.34730) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.173697+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.174729+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.175599+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.176461+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.177438+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.178281+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.179223+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.180142+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.181135+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.184330+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:07.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.187169+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:07.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:06 smithi195 bash[13978]: audit 2024-01-21T07:49:06.193574+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:07.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:05.862795+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:07.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:05.862795+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:07.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:05.866026+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:07.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:05.866026+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:07.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:05.880267+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:07.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: cluster 2024-01-21T07:49:06.043400+0000 mgr.x (mgr.34730) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:07.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.173697+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.174729+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.175599+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.176461+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.177438+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:05.880267+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100621352, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858111Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 427714150, \"cpu_percentage\": \"2.86%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858434Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"1.83%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858649Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49335500, \"cpu_percentage\": \"1.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.858856Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48475668, \"cpu_percentage\": \"1.21%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859060Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50667192, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859308Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859514Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25920798, \"cpu_percentage\": \"0.04%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859635Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50855936, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:05.859836Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:05.860160Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:07.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: cluster 2024-01-21T07:49:06.043400+0000 mgr.x (mgr.34730) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:07.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.173697+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.174729+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.175599+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.176461+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.177438+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.178281+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.179223+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.180142+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.181135+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.184330+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.187169+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[17460]: audit 2024-01-21T07:49:06.193574+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:07.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.178281+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.179223+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.180142+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:07.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.181135+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:07.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.184330+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:07.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.187169+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:07.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:06 smithi080 bash[13909]: audit 2024-01-21T07:49:06.193574+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:08.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:07 smithi195 bash[13978]: cluster 2024-01-21T07:49:06.183278+0000 mgr.x (mgr.34730) 16 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:08.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:07 smithi195 bash[13978]: cephadm 2024-01-21T07:49:06.211226+0000 mgr.x (mgr.34730) 17 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:49:08.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:07 smithi195 bash[13978]: cluster 2024-01-21T07:49:06.882570+0000 mon.a (mon.0) 615 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:49:08.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:07 smithi080 bash[13909]: cluster 2024-01-21T07:49:06.183278+0000 mgr.x (mgr.34730) 16 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:08.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:07 smithi080 bash[13909]: cephadm 2024-01-21T07:49:06.211226+0000 mgr.x (mgr.34730) 17 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:49:08.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:07 smithi080 bash[13909]: cluster 2024-01-21T07:49:06.882570+0000 mon.a (mon.0) 615 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:49:08.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:07 smithi080 bash[17460]: cluster 2024-01-21T07:49:06.183278+0000 mgr.x (mgr.34730) 16 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:08.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:07 smithi080 bash[17460]: cephadm 2024-01-21T07:49:06.211226+0000 mgr.x (mgr.34730) 17 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-01-21T07:49:08.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:07 smithi080 bash[17460]: cluster 2024-01-21T07:49:06.882570+0000 mon.a (mon.0) 615 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:49:10.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:09 smithi080 bash[13909]: cluster 2024-01-21T07:49:08.183994+0000 mgr.x (mgr.34730) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:10.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:09 smithi080 bash[17460]: cluster 2024-01-21T07:49:08.183994+0000 mgr.x (mgr.34730) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:10.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:09 smithi195 bash[13978]: cluster 2024-01-21T07:49:08.183994+0000 mgr.x (mgr.34730) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:12.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:11 smithi080 bash[13909]: cluster 2024-01-21T07:49:10.184725+0000 mgr.x (mgr.34730) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:12.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:11 smithi080 bash[17460]: cluster 2024-01-21T07:49:10.184725+0000 mgr.x (mgr.34730) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:12.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:11 smithi195 bash[13978]: cluster 2024-01-21T07:49:10.184725+0000 mgr.x (mgr.34730) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:14.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:13 smithi080 systemd[1]: Started Ceph alertmanager.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:49:14.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[13909]: cluster 2024-01-21T07:49:12.186152+0000 mgr.x (mgr.34730) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:14.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[17460]: cluster 2024-01-21T07:49:12.186152+0000 mgr.x (mgr.34730) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:14.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[17460]: audit 2024-01-21T07:49:13.869284+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:14.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[13909]: audit 2024-01-21T07:49:13.869284+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:14.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[17460]: audit 2024-01-21T07:49:13.871941+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:14.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[13909]: audit 2024-01-21T07:49:13.871941+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:14.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[17460]: audit 2024-01-21T07:49:13.877585+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:14.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[17460]: audit 2024-01-21T07:49:13.887033+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-21T07:49:14.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[17460]: audit 2024-01-21T07:49:13.889210+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-21T07:49:14.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[13909]: audit 2024-01-21T07:49:13.877585+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:14.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[13909]: audit 2024-01-21T07:49:13.887033+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-21T07:49:14.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:13 smithi080 bash[13909]: audit 2024-01-21T07:49:13.889210+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-21T07:49:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:13 smithi195 bash[13978]: cluster 2024-01-21T07:49:12.186152+0000 mgr.x (mgr.34730) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:13 smithi195 bash[13978]: audit 2024-01-21T07:49:13.869284+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:14.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:13 smithi195 bash[13978]: audit 2024-01-21T07:49:13.871941+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:14.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:13 smithi195 bash[13978]: audit 2024-01-21T07:49:13.877585+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104962457, \"cpu_percentage\": \"1.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682134Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301885030, \"cpu_percentage\": \"0.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682409Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99876864, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682527Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682638Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53393489, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682746Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682865Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49073356, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.682974Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683081Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51065651, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:04.683168Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:14.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:13 smithi195 bash[13978]: audit 2024-01-21T07:49:13.887033+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34730 172.21.15.195:0/2848251394' entity='mgr.x' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-21T07:49:14.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:13 smithi195 bash[13978]: audit 2024-01-21T07:49:13.889210+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-21T07:49:15.203 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:14 smithi195 bash[24590]: ignoring --setuser ceph since I am not root 2024-01-21T07:49:15.203 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:14 smithi195 bash[24590]: ignoring --setgroup ceph since I am not root 2024-01-21T07:49:15.203 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:14 smithi195 bash[24590]: debug 2024-01-21T07:49:14.931+0000 7f28a76ac700 1 -- 172.21.15.195:0/2068290304 <== mon.2 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5578c2f364e0 con 0x5578c302a800 2024-01-21T07:49:15.203 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:15 smithi195 bash[24590]: debug 2024-01-21T07:49:15.091+0000 7f28b7889680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:49:15.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[14168]: ignoring --setuser ceph since I am not root 2024-01-21T07:49:15.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[14168]: ignoring --setgroup ceph since I am not root 2024-01-21T07:49:15.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.926Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-01-21T07:49:15.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.926Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-01-21T07:49:15.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.928Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.80 port=9094 2024-01-21T07:49:15.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.929Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-01-21T07:49:15.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.977Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-21T07:49:15.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.978Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-21T07:49:15.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.983Z caller=main.go:518 msg=Listening address=:9093 2024-01-21T07:49:15.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:14 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:14.983Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-01-21T07:49:15.633 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:15 smithi195 bash[24590]: debug 2024-01-21T07:49:15.195+0000 7f28b7889680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:49:15.886 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:15 smithi195 bash[24590]: debug 2024-01-21T07:49:15.623+0000 7f28b7889680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:49:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:15 smithi195 bash[13978]: audit 2024-01-21T07:49:14.885181+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-01-21T07:49:16.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:15 smithi195 bash[13978]: cluster 2024-01-21T07:49:14.885282+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e21: x(active, since 31s), standbys: y 2024-01-21T07:49:16.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:15 smithi080 bash[13909]: audit 2024-01-21T07:49:14.885181+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-01-21T07:49:16.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:15 smithi080 bash[13909]: cluster 2024-01-21T07:49:14.885282+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e21: x(active, since 31s), standbys: y 2024-01-21T07:49:16.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:15 smithi080 bash[17460]: audit 2024-01-21T07:49:14.885181+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34730 ' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-01-21T07:49:16.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:15 smithi080 bash[17460]: cluster 2024-01-21T07:49:14.885282+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e21: x(active, since 31s), standbys: y 2024-01-21T07:49:16.868 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:16 smithi195 bash[24590]: debug 2024-01-21T07:49:16.523+0000 7f28b7889680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:49:16.868 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:16 smithi195 bash[24590]: debug 2024-01-21T07:49:16.615+0000 7f28b7889680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:49:17.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:16 smithi195 bash[24590]: debug 2024-01-21T07:49:16.859+0000 7f28b7889680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:49:17.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:16 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:16.930Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000728357s 2024-01-21T07:49:18.225 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:17 smithi195 bash[24590]: debug 2024-01-21T07:49:17.967+0000 7f28b7889680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:49:18.226 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:18 smithi195 bash[24590]: debug 2024-01-21T07:49:18.123+0000 7f28b7889680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:49:18.553 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:18 smithi195 bash[24590]: debug 2024-01-21T07:49:18.219+0000 7f28b7889680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:49:18.553 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:18 smithi195 bash[24590]: debug 2024-01-21T07:49:18.331+0000 7f28b7889680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:49:18.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:18 smithi195 bash[24590]: debug 2024-01-21T07:49:18.547+0000 7f28b7889680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:49:19.389 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:18 smithi195 bash[24590]: debug 2024-01-21T07:49:18.907+0000 7f28b7889680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:49:19.389 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[24590]: debug 2024-01-21T07:49:19.027+0000 7f28b7889680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:49:19.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[14168]: [21/Jan/2024:07:49:19] ENGINE Bus STARTING 2024-01-21T07:49:19.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[14168]: CherryPy Checker: 2024-01-21T07:49:19.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[14168]: The Application mounted at '' has an empty config. 2024-01-21T07:49:19.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[14168]: [21/Jan/2024:07:49:19] ENGINE Serving on http://:::9283 2024-01-21T07:49:19.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[14168]: [21/Jan/2024:07:49:19] ENGINE Bus STARTED 2024-01-21T07:49:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[13978]: cluster 2024-01-21T07:49:19.161292+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon y restarted 2024-01-21T07:49:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[13978]: cluster 2024-01-21T07:49:19.161473+0000 mon.a (mon.0) 622 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:49:20.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[13978]: audit 2024-01-21T07:49:19.165541+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.80:0/1666074639' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:49:20.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[13978]: audit 2024-01-21T07:49:19.171809+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.80:0/1666074639' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:49:20.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[24590]: debug 2024-01-21T07:49:19.879+0000 7f28b7889680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:49:20.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:19 smithi195 bash[24590]: debug 2024-01-21T07:49:19.979+0000 7f28b7889680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:49:20.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:20 smithi195 bash[24590]: debug 2024-01-21T07:49:20.095+0000 7f28b7889680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[13909]: cluster 2024-01-21T07:49:19.161292+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon y restarted 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[13909]: cluster 2024-01-21T07:49:19.161473+0000 mon.a (mon.0) 622 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[13909]: audit 2024-01-21T07:49:19.165541+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.80:0/1666074639' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[13909]: audit 2024-01-21T07:49:19.171809+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.80:0/1666074639' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[17460]: cluster 2024-01-21T07:49:19.161292+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon y restarted 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[17460]: cluster 2024-01-21T07:49:19.161473+0000 mon.a (mon.0) 622 : cluster [DBG] Standby manager daemon y started 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[17460]: audit 2024-01-21T07:49:19.165541+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.80:0/1666074639' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:49:20.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:19 smithi080 bash[17460]: audit 2024-01-21T07:49:19.171809+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.80:0/1666074639' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:49:20.605 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:20 smithi195 bash[24590]: debug 2024-01-21T07:49:20.311+0000 7f28b7889680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:49:20.881 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:20 smithi195 bash[24590]: debug 2024-01-21T07:49:20.599+0000 7f28b7889680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:49:20.882 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:20 smithi195 bash[24590]: debug 2024-01-21T07:49:20.759+0000 7f28b7889680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:49:21.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:20 smithi195 bash[13978]: cluster 2024-01-21T07:49:19.880355+0000 mon.a (mon.0) 623 : cluster [DBG] mgrmap e22: x(active, since 36s), standbys: y 2024-01-21T07:49:21.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:20 smithi195 bash[24590]: debug 2024-01-21T07:49:20.931+0000 7f28b7889680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:49:21.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:20 smithi080 bash[13909]: cluster 2024-01-21T07:49:19.880355+0000 mon.a (mon.0) 623 : cluster [DBG] mgrmap e22: x(active, since 36s), standbys: y 2024-01-21T07:49:21.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:20 smithi080 bash[17460]: cluster 2024-01-21T07:49:19.880355+0000 mon.a (mon.0) 623 : cluster [DBG] mgrmap e22: x(active, since 36s), standbys: y 2024-01-21T07:49:21.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:21 smithi195 bash[24590]: debug 2024-01-21T07:49:21.147+0000 7f28b7889680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:49:21.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:21 smithi195 bash[24590]: debug 2024-01-21T07:49:21.251+0000 7f28b7889680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:49:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:21 smithi195 bash[13978]: cluster 2024-01-21T07:49:21.276470+0000 mon.a (mon.0) 624 : cluster [INF] Active manager daemon x restarted 2024-01-21T07:49:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:21 smithi195 bash[13978]: cluster 2024-01-21T07:49:21.277759+0000 mon.a (mon.0) 625 : cluster [INF] Activating manager daemon x 2024-01-21T07:49:22.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:21 smithi195 bash[13978]: cluster 2024-01-21T07:49:21.288249+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-01-21T07:49:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:21 smithi080 bash[13909]: cluster 2024-01-21T07:49:21.276470+0000 mon.a (mon.0) 624 : cluster [INF] Active manager daemon x restarted 2024-01-21T07:49:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:21 smithi080 bash[13909]: cluster 2024-01-21T07:49:21.277759+0000 mon.a (mon.0) 625 : cluster [INF] Activating manager daemon x 2024-01-21T07:49:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:21 smithi080 bash[13909]: cluster 2024-01-21T07:49:21.288249+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-01-21T07:49:22.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:21 smithi080 bash[17460]: cluster 2024-01-21T07:49:21.276470+0000 mon.a (mon.0) 624 : cluster [INF] Active manager daemon x restarted 2024-01-21T07:49:22.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:21 smithi080 bash[17460]: cluster 2024-01-21T07:49:21.277759+0000 mon.a (mon.0) 625 : cluster [INF] Activating manager daemon x 2024-01-21T07:49:22.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:21 smithi080 bash[17460]: cluster 2024-01-21T07:49:21.288249+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-01-21T07:49:23.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:22 smithi080 bash[13909]: cluster 2024-01-21T07:49:21.899138+0000 mon.a (mon.0) 627 : cluster [DBG] mgrmap e23: x(active, starting, since 0.621628s), standbys: y 2024-01-21T07:49:23.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:22 smithi080 bash[17460]: cluster 2024-01-21T07:49:21.899138+0000 mon.a (mon.0) 627 : cluster [DBG] mgrmap e23: x(active, starting, since 0.621628s), standbys: y 2024-01-21T07:49:23.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:22 smithi195 bash[13978]: cluster 2024-01-21T07:49:21.899138+0000 mon.a (mon.0) 627 : cluster [DBG] mgrmap e23: x(active, starting, since 0.621628s), standbys: y 2024-01-21T07:49:25.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:49:24 smithi080 bash[34846]: level=info ts=2024-01-21T07:49:24.931Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.001927473s 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.903759+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.904166+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.904574+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.906570+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.907035+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.907598+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.908156+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.908638+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.909122+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:49:28.221 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.909582+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.910062+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.910527+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.910981+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.912704+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.913289+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.914638+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.915927+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.916981+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.917533+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.918053+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.918570+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.919155+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.919730+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:49:28.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.920235+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.920731+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.921217+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.921696+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.922177+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.922663+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.923162+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.923662+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.924136+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.924617+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.925104+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.925580+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.926077+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.926580+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:49:28.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.927095+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:49:28.224 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.927646+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:49:28.224 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: audit 2024-01-21T07:49:27.928154+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:49:28.224 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:27 smithi195 bash[13978]: cluster 2024-01-21T07:49:27.935493+0000 mon.a (mon.0) 628 : cluster [INF] Manager daemon x is now available 2024-01-21T07:49:28.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.903759+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:49:28.224 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.904166+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.904574+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.906570+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.907035+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.907598+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.908156+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.908638+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.909122+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.909582+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.910062+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.910527+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.910981+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.912704+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.913289+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:49:28.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.914638+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.915927+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.916981+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: Warning: Permanently added 'smithi195,172.21.15.195' (ECDSA) to the list of known hosts. 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: [21/Jan/2024:07:49:28] ENGINE Bus STARTING 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.903759+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.904166+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.904574+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.906570+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:49:28.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.907035+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.907598+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.908156+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.908638+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.909122+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.909582+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.910062+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.910527+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.910981+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.912704+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.913289+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.914638+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.915927+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:49:28.227 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.916981+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.917533+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.918053+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.918570+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.919155+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.919730+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.920235+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.920731+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.921217+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.921696+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:49:28.228 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.922177+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.922663+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.923162+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.923662+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.924136+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.924617+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.925104+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.925580+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.926077+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.926580+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.927095+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.927646+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: audit 2024-01-21T07:49:27.928154+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:49:28.229 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[13909]: cluster 2024-01-21T07:49:27.935493+0000 mon.a (mon.0) 628 : cluster [INF] Manager daemon x is now available 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.917533+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.918053+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.918570+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.919155+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.919730+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.920235+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.920731+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.921217+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.921696+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.922177+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.922663+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:49:28.230 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.923162+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.923662+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.924136+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.924617+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.925104+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.925580+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.926077+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.926580+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.927095+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.927646+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: audit 2024-01-21T07:49:27.928154+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:49:28.231 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:27 smithi080 bash[17460]: cluster 2024-01-21T07:49:27.935493+0000 mon.a (mon.0) 628 : cluster [INF] Manager daemon x is now available 2024-01-21T07:49:28.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: CherryPy Checker: 2024-01-21T07:49:28.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: The Application mounted at '' has an empty config. 2024-01-21T07:49:28.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: [21/Jan/2024:07:49:28] ENGINE Serving on http://:::9283 2024-01-21T07:49:28.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:28 smithi195 bash[24590]: [21/Jan/2024:07:49:28] ENGINE Bus STARTED 2024-01-21T07:49:29.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: cluster 2024-01-21T07:49:27.996635+0000 mon.a (mon.0) 629 : cluster [DBG] mgrmap e24: x(active, since 6s), standbys: y 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: cluster 2024-01-21T07:49:28.004516+0000 mgr.x (mgr.34778) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.099192+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.101657+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.166407+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.168563+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.175826+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]': finished 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.182003+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.184045+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.188420+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]': finished 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.194411+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:49:29.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.196432+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.205037+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.207065+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.502726+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[13909]: audit 2024-01-21T07:49:28.503368+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: cluster 2024-01-21T07:49:27.996635+0000 mon.a (mon.0) 629 : cluster [DBG] mgrmap e24: x(active, since 6s), standbys: y 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: cluster 2024-01-21T07:49:28.004516+0000 mgr.x (mgr.34778) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.099192+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.101657+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.166407+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.168563+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]: dispatch 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.175826+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]': finished 2024-01-21T07:49:29.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.182003+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.184045+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.188420+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]': finished 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.194411+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.196432+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.205037+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.207065+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.502726+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:29.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:29 smithi080 bash[17460]: audit 2024-01-21T07:49:28.503368+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:29.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: cluster 2024-01-21T07:49:27.996635+0000 mon.a (mon.0) 629 : cluster [DBG] mgrmap e24: x(active, since 6s), standbys: y 2024-01-21T07:49:29.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: cluster 2024-01-21T07:49:28.004516+0000 mgr.x (mgr.34778) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:29.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.099192+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:29.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.101657+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.166407+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.168563+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.175826+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{}"}]': finished 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.182003+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.184045+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.188420+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/prometheus/health_history","val":"{\"CEPHADM_FAILED_DAEMON\": {\"name\": \"CEPHADM_FAILED_DAEMON\", \"severity\": \"HEALTH_WARN\", \"first_seen\": 1705823368.1814208, \"last_seen\": 1705823368.1814208, \"count\": 1, \"active\": true}}"}]': finished 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.194411+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.196432+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.205037+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.207065+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.502726+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:29.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:29 smithi195 bash[13978]: audit 2024-01-21T07:49:28.503368+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:29.755 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:49:30.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[17460]: cluster 2024-01-21T07:49:28.990275+0000 mon.a (mon.0) 636 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:49:30.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[17460]: cluster 2024-01-21T07:49:28.990352+0000 mon.a (mon.0) 637 : cluster [INF] Cluster is now healthy 2024-01-21T07:49:30.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[17460]: audit 2024-01-21T07:49:29.736356+0000 mgr.x (mgr.34778) 2 : audit [DBG] from='client.24832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:30.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[17460]: cluster 2024-01-21T07:49:29.913059+0000 mgr.x (mgr.34778) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:30.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[13909]: cluster 2024-01-21T07:49:28.990275+0000 mon.a (mon.0) 636 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:49:30.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[13909]: cluster 2024-01-21T07:49:28.990352+0000 mon.a (mon.0) 637 : cluster [INF] Cluster is now healthy 2024-01-21T07:49:30.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[13909]: audit 2024-01-21T07:49:29.736356+0000 mgr.x (mgr.34778) 2 : audit [DBG] from='client.24832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:30.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:30 smithi080 bash[13909]: cluster 2024-01-21T07:49:29.913059+0000 mgr.x (mgr.34778) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:30 smithi195 bash[13978]: cluster 2024-01-21T07:49:28.990275+0000 mon.a (mon.0) 636 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:49:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:30 smithi195 bash[13978]: cluster 2024-01-21T07:49:28.990352+0000 mon.a (mon.0) 637 : cluster [INF] Cluster is now healthy 2024-01-21T07:49:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:30 smithi195 bash[13978]: audit 2024-01-21T07:49:29.736356+0000 mgr.x (mgr.34778) 2 : audit [DBG] from='client.24832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:30.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:30 smithi195 bash[13978]: cluster 2024-01-21T07:49:29.913059+0000 mgr.x (mgr.34778) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:alertmanager.a smithi080 *:9093,9094 starting - - - - 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (6m) 24s ago 6m 24.7M - 6.6.2 87a51ecf0b1c d6c769fa64de 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (56s) 24s ago 10m 407M - 16.2.14-454-gea310589 9b28eb2d7c37 82dc6695abd6 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (12m) 25s ago 12m 287M - 15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (12m) 25s ago 12m 100M 2048M 15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (10m) 24s ago 10m 95.9M 2048M 15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (11m) 25s ago 11m 95.2M 2048M 15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 25s ago 6m - - 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 24s ago 6m - - 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (10m) 25s ago 10m 49.8M 4096M 15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:49:30.500 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (9m) 25s ago 9m 50.9M 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (9m) 25s ago 9m 44.7M 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (8m) 25s ago 9m 46.7M 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (8m) 24s ago 8m 48.3M 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (8m) 24s ago 8m 47.0M 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (7m) 24s ago 7m 46.2M 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (7m) 24s ago 7m 48.3M 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (4m) 25s ago 4m 48.7M - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:49:30.501 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (4m) 24s ago 4m 48.5M - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:49:30.925 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:49:30.926 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:49:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:49:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:49:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-01-21T07:49:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:49:30.927 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:49:30.927 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:49:31.272 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:49:31.272 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:49:31.272 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:49:31.272 INFO:teuthology.orchestra.run.smithi080.stdout: "which": "Upgrading all daemon types on all hosts", 2024-01-21T07:49:31.273 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:49:31.273 INFO:teuthology.orchestra.run.smithi080.stdout: "progress": "", 2024-01-21T07:49:31.273 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "", 2024-01-21T07:49:31.273 INFO:teuthology.orchestra.run.smithi080.stdout: "is_paused": false 2024-01-21T07:49:31.273 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:49:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: cluster 2024-01-21T07:49:30.018089+0000 mon.a (mon.0) 638 : cluster [DBG] mgrmap e25: x(active, since 8s), standbys: y 2024-01-21T07:49:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.108139+0000 mgr.x (mgr.34778) 4 : audit [DBG] from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.470836+0000 mgr.x (mgr.34778) 5 : audit [DBG] from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.476297+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.477499+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.478608+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.479717+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.480801+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.481816+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.484352+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.485172+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.485991+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.486767+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.487514+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[13909]: audit 2024-01-21T07:49:30.923840+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.80:0/831145216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: cluster 2024-01-21T07:49:30.018089+0000 mon.a (mon.0) 638 : cluster [DBG] mgrmap e25: x(active, since 8s), standbys: y 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.108139+0000 mgr.x (mgr.34778) 4 : audit [DBG] from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.470836+0000 mgr.x (mgr.34778) 5 : audit [DBG] from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:31.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.476297+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.477499+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.478608+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.479717+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.480801+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.481816+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.484352+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.485172+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.485991+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.486767+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.487514+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:31 smithi080 bash[17460]: audit 2024-01-21T07:49:30.923840+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.80:0/831145216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:49:31.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: cluster 2024-01-21T07:49:30.018089+0000 mon.a (mon.0) 638 : cluster [DBG] mgrmap e25: x(active, since 8s), standbys: y 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.108139+0000 mgr.x (mgr.34778) 4 : audit [DBG] from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.470836+0000 mgr.x (mgr.34778) 5 : audit [DBG] from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.476297+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.477499+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.478608+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.479717+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.480801+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.481816+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.484352+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.485172+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.485991+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.486767+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.487514+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:31.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:31 smithi195 bash[13978]: audit 2024-01-21T07:49:30.923840+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.80:0/831145216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:49:32.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:32 smithi080 bash[13909]: audit 2024-01-21T07:49:31.268653+0000 mgr.x (mgr.34778) 6 : audit [DBG] from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:32.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:32 smithi080 bash[13909]: cluster 2024-01-21T07:49:31.913774+0000 mgr.x (mgr.34778) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:32.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:32 smithi080 bash[17460]: audit 2024-01-21T07:49:31.268653+0000 mgr.x (mgr.34778) 6 : audit [DBG] from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:32.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:32 smithi080 bash[17460]: cluster 2024-01-21T07:49:31.913774+0000 mgr.x (mgr.34778) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:32.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:32 smithi195 bash[13978]: audit 2024-01-21T07:49:31.268653+0000 mgr.x (mgr.34778) 6 : audit [DBG] from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:49:32.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:32 smithi195 bash[13978]: cluster 2024-01-21T07:49:31.913774+0000 mgr.x (mgr.34778) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:35.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: cluster 2024-01-21T07:49:33.914887+0000 mgr.x (mgr.34778) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:35.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.375085+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.377964+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.383748+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:35.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.530241+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.532965+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.539252+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.646232+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.647252+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.648154+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.648977+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.650028+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.650864+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.651752+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.652603+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.653506+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.142 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.806322+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.807404+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.808358+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.809205+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.810052+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.810882+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.811606+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.812275+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.813000+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.815517+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:35.143 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.818725+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:35.144 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:34 smithi195 bash[13978]: audit 2024-01-21T07:49:34.824385+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:35.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: cluster 2024-01-21T07:49:33.914887+0000 mgr.x (mgr.34778) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:35.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: cluster 2024-01-21T07:49:33.914887+0000 mgr.x (mgr.34778) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:35.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.375085+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.375085+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.377964+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.377964+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.383748+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.383748+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:35.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.530241+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.530241+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.532965+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.539252+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.646232+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.532965+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:35.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.539252+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.528574Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:35.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.646232+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.647252+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.648154+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.648977+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.650028+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.650864+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.651752+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.652603+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.653506+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.806322+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.807404+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.808358+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.809205+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.810052+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.810882+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.811606+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.812275+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.813000+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.815517+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.818725+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:35.315 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[17460]: audit 2024-01-21T07:49:34.824385+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.647252+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.648154+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.648977+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.650028+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.650864+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.651752+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.652603+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.653506+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.806322+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.807404+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.808358+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.809205+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.810052+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.810882+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.811606+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.812275+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:49:35.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.813000+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:49:35.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.815517+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:35.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.818725+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:35.317 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:34 smithi080 bash[13909]: audit 2024-01-21T07:49:34.824385+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:36.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:35 smithi195 bash[13978]: cephadm 2024-01-21T07:49:34.849903+0000 mgr.x (mgr.34778) 10 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:49:36.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:35 smithi195 bash[13978]: cluster 2024-01-21T07:49:34.863435+0000 mon.a (mon.0) 645 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:49:36.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:35 smithi080 bash[13909]: cephadm 2024-01-21T07:49:34.849903+0000 mgr.x (mgr.34778) 10 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:49:36.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:35 smithi080 bash[13909]: cluster 2024-01-21T07:49:34.863435+0000 mon.a (mon.0) 645 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:49:36.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:35 smithi080 bash[17460]: cephadm 2024-01-21T07:49:34.849903+0000 mgr.x (mgr.34778) 10 : cephadm [INF] Deploying daemon prometheus.a on smithi195 2024-01-21T07:49:36.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:35 smithi080 bash[17460]: cluster 2024-01-21T07:49:34.863435+0000 mon.a (mon.0) 645 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:49:38.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:37 smithi080 bash[13909]: cluster 2024-01-21T07:49:36.815335+0000 mgr.x (mgr.34778) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:38.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:37 smithi080 bash[17460]: cluster 2024-01-21T07:49:36.815335+0000 mgr.x (mgr.34778) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:38.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:37 smithi195 bash[13978]: cluster 2024-01-21T07:49:36.815335+0000 mgr.x (mgr.34778) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:40.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:39 smithi080 bash[13909]: cluster 2024-01-21T07:49:38.816326+0000 mgr.x (mgr.34778) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:40.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:39 smithi080 bash[17460]: cluster 2024-01-21T07:49:38.816326+0000 mgr.x (mgr.34778) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:40.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:39 smithi195 bash[13978]: cluster 2024-01-21T07:49:38.816326+0000 mgr.x (mgr.34778) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:42.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:41 smithi080 bash[13909]: cluster 2024-01-21T07:49:40.817041+0000 mgr.x (mgr.34778) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:42.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:41 smithi080 bash[17460]: cluster 2024-01-21T07:49:40.817041+0000 mgr.x (mgr.34778) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:42.420 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:41 smithi195 bash[13978]: cluster 2024-01-21T07:49:40.817041+0000 mgr.x (mgr.34778) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:44.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:43 smithi080 bash[13909]: cluster 2024-01-21T07:49:42.817934+0000 mgr.x (mgr.34778) 14 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:44.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:43 smithi080 bash[17460]: cluster 2024-01-21T07:49:42.817934+0000 mgr.x (mgr.34778) 14 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:44.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:43 smithi195 bash[13978]: cluster 2024-01-21T07:49:42.817934+0000 mgr.x (mgr.34778) 14 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:46.172 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:45 smithi195 bash[13978]: cluster 2024-01-21T07:49:44.819568+0000 mgr.x (mgr.34778) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:46.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:45 smithi080 bash[13909]: cluster 2024-01-21T07:49:44.819568+0000 mgr.x (mgr.34778) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:46.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:45 smithi080 bash[17460]: cluster 2024-01-21T07:49:44.819568+0000 mgr.x (mgr.34778) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:46.443 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:46 smithi195 systemd[1]: Started Ceph prometheus.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:49:47.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[13909]: audit 2024-01-21T07:49:46.410565+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:47.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[17460]: audit 2024-01-21T07:49:46.410565+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:47.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[17460]: audit 2024-01-21T07:49:46.413271+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:47.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[13909]: audit 2024-01-21T07:49:46.413271+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:47.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[13909]: audit 2024-01-21T07:49:46.420100+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:47.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[13909]: audit 2024-01-21T07:49:46.421680+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:47.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[13909]: audit 2024-01-21T07:49:46.423928+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:47.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[17460]: audit 2024-01-21T07:49:46.420100+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:47.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[17460]: audit 2024-01-21T07:49:46.421680+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:47.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:46 smithi080 bash[17460]: audit 2024-01-21T07:49:46.423928+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:47.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:46 smithi195 bash[13978]: audit 2024-01-21T07:49:46.410565+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:47.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:46 smithi195 bash[13978]: audit 2024-01-21T07:49:46.413271+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:47.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:46 smithi195 bash[13978]: audit 2024-01-21T07:49:46.420100+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111463628, \"cpu_percentage\": \"1.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527528Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 429706444, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527720Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51191480, \"cpu_percentage\": \"2.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527830Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"3.07%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.527934Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48926556, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528036Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51474595, \"cpu_percentage\": \"3.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528138Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528240Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26214400, \"cpu_percentage\": \"3.18%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528302Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51317309, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.528404Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9095]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:47.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:46 smithi195 bash[13978]: audit 2024-01-21T07:49:46.421680+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:49:47.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:46 smithi195 bash[13978]: audit 2024-01-21T07:49:46.423928+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.571Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.571Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.571Z caller=main.go:518 level=info host_details="(Linux 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 smithi195 (none))" 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.571Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.571Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.574Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.575Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.575Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.584Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.584Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.674µs 2024-01-21T07:49:47.889 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.584Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.584Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.584Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=63.384µs wal_replay_duration=370.012µs total_replay_duration=474.032µs 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.587Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.587Z caller=main.go:947 level=info msg="TSDB started" 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.587Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.616Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=29.399804ms db_storage=1.122µs remote_storage=1.588µs web_handler=411ns query_engine=739ns scrape=347.311µs scrape_sd=33.395µs notify=22.434µs notify_sd=6.718µs rules=28.725109ms 2024-01-21T07:49:47.890 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[26660]: ts=2024-01-21T07:49:47.616Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-01-21T07:49:48.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:47 smithi080 bash[13909]: cluster 2024-01-21T07:49:46.820341+0000 mgr.x (mgr.34778) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:48.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:47 smithi080 bash[17460]: cluster 2024-01-21T07:49:46.820341+0000 mgr.x (mgr.34778) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:48.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:47 smithi195 bash[13978]: cluster 2024-01-21T07:49:46.820341+0000 mgr.x (mgr.34778) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:49.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:48 smithi080 bash[13909]: audit 2024-01-21T07:49:48.184477+0000 mon.b (mon.2) 191 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:49:49.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:48 smithi080 bash[13909]: audit 2024-01-21T07:49:48.186984+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:49:49.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:48 smithi080 bash[13909]: audit 2024-01-21T07:49:48.193305+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:49:49.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:48 smithi080 bash[17460]: audit 2024-01-21T07:49:48.184477+0000 mon.b (mon.2) 191 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:49:49.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:48 smithi080 bash[17460]: audit 2024-01-21T07:49:48.186984+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:49:49.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:48 smithi080 bash[17460]: audit 2024-01-21T07:49:48.193305+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:49:49.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:48 smithi195 bash[13978]: audit 2024-01-21T07:49:48.184477+0000 mon.b (mon.2) 191 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:49:49.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:48 smithi195 bash[13978]: audit 2024-01-21T07:49:48.186984+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-01-21T07:49:49.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:48 smithi195 bash[13978]: audit 2024-01-21T07:49:48.193305+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"1e712757-e57b-4227-b2bb-02d1183f2b74\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1705822875.3510861, \"finished_at\": 1705823368.1667814, \"add_to_ceph_s:\": 1705822858.7838347}, {\"id\": \"96cdfa50-3343-4cc5-89d6-b59729e75289\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1705822901.0314648, \"finished_at\": 1705823368.1667914, \"add_to_ceph_s:\": 1705822884.8303626}, {\"id\": \"91b9c6b7-5d3d-4617-9cf5-03da88a876a0\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1705822927.5239966, \"finished_at\": 1705823368.1667962, \"add_to_ceph_s:\": 1705822911.7721117}, {\"id\": \"7b8dd7d8-cc26-4c1f-9fba-25c574b932af\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1705822944.738381, \"finished_at\": 1705823368.166801, \"add_to_ceph_s:\": 1705822936.7615461}, {\"id\": \"6eeb00ff-8959-4910-846d-f587ddf44d59\", \"message\": \"Updating prometheus deployment (+1 -> 1)\", \"refs\": [], \"started_at\": 1705823374.828195, \"finished_at\": 1705823386.4203866, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-01-21T07:49:50.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:49 smithi080 bash[13909]: cluster 2024-01-21T07:49:48.821857+0000 mgr.x (mgr.34778) 17 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:50.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:49 smithi080 bash[17460]: cluster 2024-01-21T07:49:48.821857+0000 mgr.x (mgr.34778) 17 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:50.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:49 smithi195 bash[13978]: cluster 2024-01-21T07:49:48.821857+0000 mgr.x (mgr.34778) 17 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:52.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:51 smithi080 bash[13909]: cluster 2024-01-21T07:49:50.822621+0000 mgr.x (mgr.34778) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:52.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:51 smithi080 bash[17460]: cluster 2024-01-21T07:49:50.822621+0000 mgr.x (mgr.34778) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:52.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:51 smithi195 bash[13978]: cluster 2024-01-21T07:49:50.822621+0000 mgr.x (mgr.34778) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:52.928 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[14168]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:49:52] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:49:53.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.684740+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:53.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.684740+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.687645+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:53.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.694383+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.696664+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.699678+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.705352+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.709873+0000 mon.b (mon.2) 194 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.711098+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.712257+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[13909]: audit 2024-01-21T07:49:52.714070+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:49:53.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.687645+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.694383+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.696664+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.699678+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.705352+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.709873+0000 mon.b (mon.2) 194 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.711098+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.712257+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:49:53.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:52 smithi080 bash[17460]: audit 2024-01-21T07:49:52.714070+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:49:53.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.684740+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.687645+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.694383+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:31.229245Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.696664+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.699678+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.705352+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.709873+0000 mon.b (mon.2) 194 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.711098+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.712257+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:49:53.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:52 smithi195 bash[13978]: audit 2024-01-21T07:49:52.714070+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:49:54.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[13909]: cluster 2024-01-21T07:49:52.695247+0000 mgr.x (mgr.34778) 19 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:54.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[13909]: cluster 2024-01-21T07:49:52.695670+0000 mgr.x (mgr.34778) 20 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:54.214 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[13909]: cephadm 2024-01-21T07:49:52.709393+0000 mgr.x (mgr.34778) 21 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-01-21T07:49:54.214 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[13909]: cephadm 2024-01-21T07:49:52.713340+0000 mgr.x (mgr.34778) 22 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-01-21T07:49:54.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[17460]: cluster 2024-01-21T07:49:52.695247+0000 mgr.x (mgr.34778) 19 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:54.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[17460]: cluster 2024-01-21T07:49:52.695670+0000 mgr.x (mgr.34778) 20 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:54.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[17460]: cephadm 2024-01-21T07:49:52.709393+0000 mgr.x (mgr.34778) 21 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-01-21T07:49:54.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:53 smithi080 bash[17460]: cephadm 2024-01-21T07:49:52.713340+0000 mgr.x (mgr.34778) 22 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-01-21T07:49:54.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:53 smithi195 bash[13978]: cluster 2024-01-21T07:49:52.695247+0000 mgr.x (mgr.34778) 19 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:54.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:53 smithi195 bash[13978]: cluster 2024-01-21T07:49:52.695670+0000 mgr.x (mgr.34778) 20 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:54.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:53 smithi195 bash[13978]: cephadm 2024-01-21T07:49:52.709393+0000 mgr.x (mgr.34778) 21 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-01-21T07:49:54.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:53 smithi195 bash[13978]: cephadm 2024-01-21T07:49:52.713340+0000 mgr.x (mgr.34778) 22 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-01-21T07:49:55.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: cluster 2024-01-21T07:49:54.697112+0000 mgr.x (mgr.34778) 23 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:55.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: cluster 2024-01-21T07:49:54.697112+0000 mgr.x (mgr.34778) 23 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:55.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.907895+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:55.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.907895+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:55.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.910931+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:55.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.910931+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.915638+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: cephadm 2024-01-21T07:49:54.918484+0000 mgr.x (mgr.34778) 24 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.919049+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.920651+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.922342+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: cephadm 2024-01-21T07:49:54.923873+0000 mgr.x (mgr.34778) 25 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[13909]: audit 2024-01-21T07:49:54.924876+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:49:55.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.915638+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:55.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: cephadm 2024-01-21T07:49:54.918484+0000 mgr.x (mgr.34778) 24 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-01-21T07:49:55.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.919049+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:49:55.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.920651+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:49:55.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.922342+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:49:55.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: cephadm 2024-01-21T07:49:54.923873+0000 mgr.x (mgr.34778) 25 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-01-21T07:49:55.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:54 smithi080 bash[17460]: audit 2024-01-21T07:49:54.924876+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:49:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: cluster 2024-01-21T07:49:54.697112+0000 mgr.x (mgr.34778) 23 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.907895+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.910931+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.915638+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:16.341404Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: cephadm 2024-01-21T07:49:54.918484+0000 mgr.x (mgr.34778) 24 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.919049+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.920651+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.922342+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: cephadm 2024-01-21T07:49:54.923873+0000 mgr.x (mgr.34778) 25 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-01-21T07:49:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:54 smithi195 bash[13978]: audit 2024-01-21T07:49:54.924876+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:49:57.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:56 smithi080 bash[17460]: audit 2024-01-21T07:49:56.721072+0000 mon.b (mon.2) 203 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:49:57.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:56 smithi080 bash[13909]: audit 2024-01-21T07:49:56.721072+0000 mon.b (mon.2) 203 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:49:57.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:56 smithi080 bash[17460]: audit 2024-01-21T07:49:56.724066+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:49:57.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:56 smithi080 bash[17460]: audit 2024-01-21T07:49:56.730538+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:49:57.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:56 smithi080 bash[13909]: audit 2024-01-21T07:49:56.724066+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:49:57.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:56 smithi080 bash[13909]: audit 2024-01-21T07:49:56.730538+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:49:57.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:49:56 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:49:56] "GET /metrics HTTP/1.1" 200 152508 "" "Prometheus/2.33.4" 2024-01-21T07:49:57.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:56 smithi195 bash[13978]: audit 2024-01-21T07:49:56.721072+0000 mon.b (mon.2) 203 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:49:57.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:56 smithi195 bash[13978]: audit 2024-01-21T07:49:56.724066+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:49:57.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:56 smithi195 bash[13978]: audit 2024-01-21T07:49:56.730538+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"8efa5300f5c8\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 14942208, \"cpu_percentage\": \"0.10%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:49:34.371369Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:49:13.897434Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:06.211048Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:34.371787Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:49:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:57 smithi080 bash[13909]: cluster 2024-01-21T07:49:56.697875+0000 mgr.x (mgr.34778) 26 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:57 smithi080 bash[13909]: cephadm 2024-01-21T07:49:56.733151+0000 mgr.x (mgr.34778) 27 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-01-21T07:49:58.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:57 smithi080 bash[13909]: cephadm 2024-01-21T07:49:56.747575+0000 mgr.x (mgr.34778) 28 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-01-21T07:49:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:57 smithi080 bash[17460]: cluster 2024-01-21T07:49:56.697875+0000 mgr.x (mgr.34778) 26 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:57 smithi080 bash[17460]: cephadm 2024-01-21T07:49:56.733151+0000 mgr.x (mgr.34778) 27 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-01-21T07:49:58.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:57 smithi080 bash[17460]: cephadm 2024-01-21T07:49:56.747575+0000 mgr.x (mgr.34778) 28 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-01-21T07:49:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:57 smithi195 bash[13978]: cluster 2024-01-21T07:49:56.697875+0000 mgr.x (mgr.34778) 26 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:49:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:57 smithi195 bash[13978]: cephadm 2024-01-21T07:49:56.733151+0000 mgr.x (mgr.34778) 27 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-01-21T07:49:58.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:57 smithi195 bash[13978]: cephadm 2024-01-21T07:49:56.747575+0000 mgr.x (mgr.34778) 28 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-01-21T07:50:00.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:49:59 smithi080 bash[13909]: cluster 2024-01-21T07:49:58.699366+0000 mgr.x (mgr.34778) 29 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:00.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:49:59 smithi080 bash[17460]: cluster 2024-01-21T07:49:58.699366+0000 mgr.x (mgr.34778) 29 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:00.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:49:59 smithi195 bash[13978]: cluster 2024-01-21T07:49:58.699366+0000 mgr.x (mgr.34778) 29 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:00.533 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:00 smithi080 systemd[1]: Stopping Ceph alertmanager.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:50:00.533 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:00 smithi080 bash[35958]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-alertmanager.a 2024-01-21T07:50:00.533 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:00 smithi080 bash[34846]: level=info ts=2024-01-21T07:50:00.354Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-01-21T07:50:01.126 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:00 smithi080 bash[35993]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-alertmanager-a 2024-01-21T07:50:01.126 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[36060]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-alertmanager-a 2024-01-21T07:50:01.126 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:01 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@alertmanager.a.service: Succeeded. 2024-01-21T07:50:01.126 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:01 smithi080 systemd[1]: Stopped Ceph alertmanager.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:50:01.126 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:01 smithi080 systemd[1]: Started Ceph alertmanager.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:50:01.665 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:50:02.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.028Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.028Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.030Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.80 port=9094 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.034Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.084Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.084Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.088Z caller=main.go:518 msg=Listening address=:9093 2024-01-21T07:50:02.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:02.088Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-01-21T07:50:02.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: cluster 2024-01-21T07:50:00.700107+0000 mgr.x (mgr.34778) 30 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:02.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.099612+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:02.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: cluster 2024-01-21T07:50:00.700107+0000 mgr.x (mgr.34778) 30 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:02.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.102182+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:02.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.108743+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:02.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.110907+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:50:02.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.112625+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:50:02.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.114244+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:50:02.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[13909]: audit 2024-01-21T07:50:01.116838+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:50:02.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.099612+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:02.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.102182+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:02.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.108743+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:02.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.110907+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:50:02.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.112625+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:50:02.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.114244+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:50:02.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:01 smithi080 bash[17460]: audit 2024-01-21T07:50:01.116838+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:50:02.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: cluster 2024-01-21T07:50:00.700107+0000 mgr.x (mgr.34778) 30 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:02.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.099612+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:02.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.102182+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:02.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.108743+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"49ff7d975d43\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302409318, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369226Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:36:49.414025Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:38:52.759923Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:02.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.110907+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:50:02.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.112625+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:50:02.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.114244+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:50:02.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:01 smithi195 bash[13978]: audit 2024-01-21T07:50:01.116838+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:alertmanager.a smithi080 *:9093,9094 starting - - - - 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (6m) 9s ago 6m 25.2M - 6.6.2 87a51ecf0b1c d6c769fa64de 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (88s) 9s ago 11m 415M - 16.2.14-454-gea310589 9b28eb2d7c37 82dc6695abd6 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (13m) 28s ago 13m 288M - 15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (13m) 28s ago 13m 108M 2048M 15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (11m) 9s ago 11m 106M 2048M 15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:50:02.427 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (11m) 28s ago 11m 102M 2048M 15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 28s ago 7m - - 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 9s ago 7m - - 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (10m) 28s ago 10m 50.4M 4096M 15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (10m) 28s ago 10m 50.9M 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (9m) 28s ago 10m 44.9M 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (9m) 28s ago 9m 47.2M 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (9m) 9s ago 9m 48.8M 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (8m) 9s ago 8m 47.4M 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (8m) 9s ago 8m 46.4M 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (7m) 9s ago 7m 49.3M 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:prometheus.a smithi195 *:9095 running (15s) 9s ago 16s 25.7M - 2.33.4 514e6a882f6e 9c7157bf1685 2024-01-21T07:50:02.428 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (5m) 28s ago 5m 49.2M - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:50:02.429 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (5m) 9s ago 5m 48.8M - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:50:02.855 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:50:02.855 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-01-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:50:03.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[14168]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:02] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:50:03.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: cephadm 2024-01-21T07:50:01.110349+0000 mgr.x (mgr.34778) 31 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: cephadm 2024-01-21T07:50:01.115825+0000 mgr.x (mgr.34778) 32 : cephadm [INF] Reconfiguring daemon mon.b on smithi195 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:01.643800+0000 mgr.x (mgr.34778) 33 : audit [DBG] from='client.24862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.400389+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.401577+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.402510+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.403587+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.404623+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.405618+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.411178+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.412142+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.413087+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.413781+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.414420+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[13909]: audit 2024-01-21T07:50:02.853535+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.80:0/3269176899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: cephadm 2024-01-21T07:50:01.110349+0000 mgr.x (mgr.34778) 31 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: cephadm 2024-01-21T07:50:01.115825+0000 mgr.x (mgr.34778) 32 : cephadm [INF] Reconfiguring daemon mon.b on smithi195 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:01.643800+0000 mgr.x (mgr.34778) 33 : audit [DBG] from='client.24862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.400389+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.401577+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.402510+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.403587+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.404623+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.405618+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.411178+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.412142+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.413087+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.413781+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.414420+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:02 smithi080 bash[17460]: audit 2024-01-21T07:50:02.853535+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.80:0/3269176899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: cephadm 2024-01-21T07:50:01.110349+0000 mgr.x (mgr.34778) 31 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: cephadm 2024-01-21T07:50:01.115825+0000 mgr.x (mgr.34778) 32 : cephadm [INF] Reconfiguring daemon mon.b on smithi195 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:01.643800+0000 mgr.x (mgr.34778) 33 : audit [DBG] from='client.24862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.400389+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.401577+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.402510+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.403587+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.404623+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.405618+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.411178+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.412142+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.413087+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.413781+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.414420+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:03.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:02 smithi195 bash[13978]: audit 2024-01-21T07:50:02.853535+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.80:0/3269176899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:50:03.215 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec", 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "which": "Upgrading all daemon types on all hosts", 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "progress": "", 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "", 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout: "is_paused": false 2024-01-21T07:50:03.216 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:50:03.888 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[24590]: [21/Jan/2024:07:50:03] ENGINE Bus STOPPING 2024-01-21T07:50:03.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[24590]: [21/Jan/2024:07:50:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-21T07:50:03.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[24590]: [21/Jan/2024:07:50:03] ENGINE Bus STOPPED 2024-01-21T07:50:03.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[24590]: [21/Jan/2024:07:50:03] ENGINE Bus STARTING 2024-01-21T07:50:03.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[24590]: [21/Jan/2024:07:50:03] ENGINE Serving on http://:::9283 2024-01-21T07:50:03.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[24590]: [21/Jan/2024:07:50:03] ENGINE Bus STARTED 2024-01-21T07:50:04.308 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:04.034Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00080818s 2024-01-21T07:50:04.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:02.042735+0000 mgr.x (mgr.34778) 34 : audit [DBG] from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:04.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:02.395214+0000 mgr.x (mgr.34778) 35 : audit [DBG] from='client.24874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:04.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: cluster 2024-01-21T07:50:02.700820+0000 mgr.x (mgr.34778) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:04.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:02.042735+0000 mgr.x (mgr.34778) 34 : audit [DBG] from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:04.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:02.395214+0000 mgr.x (mgr.34778) 35 : audit [DBG] from='client.24874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:04.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: cluster 2024-01-21T07:50:02.700820+0000 mgr.x (mgr.34778) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:04.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.340730+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:50:04.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.340730+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:50:04.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.343641+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:50:04.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.343641+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:50:04.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.350102+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:50:04.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.462352+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:50:04.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.350102+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:50:04.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.462352+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:50:04.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.464731+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:50:04.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.470484+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:50:04.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.470652+0000 mon.b (mon.2) 222 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.464731+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.470484+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.470652+0000 mon.b (mon.2) 222 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.472947+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.478417+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.481691+0000 mon.b (mon.2) 223 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.483190+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-01-21T07:50:04.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.485242+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[13909]: audit 2024-01-21T07:50:03.492091+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.472947+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.478417+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.481691+0000 mon.b (mon.2) 223 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.483190+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.485242+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-01-21T07:50:04.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:03 smithi080 bash[17460]: audit 2024-01-21T07:50:03.492091+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2024-01-21T07:50:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:02.042735+0000 mgr.x (mgr.34778) 34 : audit [DBG] from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:02.395214+0000 mgr.x (mgr.34778) 35 : audit [DBG] from='client.24874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: cluster 2024-01-21T07:50:02.700820+0000 mgr.x (mgr.34778) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:04.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.340730+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:50:04.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.343641+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:50:04.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.350102+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"d6c769fa64de\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 26466058, \"cpu_percentage\": \"1.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680632Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:43:14.193871Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:49.737816Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:49:52.681391Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:50:04.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.462352+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.464731+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.470484+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyTCCAbECEE9foJxJW0Q2mCHIaAmLElQwDQYJKoZIhvcNAQENBQAwIzENMAsG\nA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhpMTk1MB4XDTI0MDEyMTA3NTAwM1oX\nDTM0MDExODA3NTAwM1owIzENMAsGA1UECgwEQ2VwaDESMBAGA1UEAwwJc21pdGhp\nMTk1MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA422ntJD+hhCb5sKz\nggiHK5cbkKo12bUsSr5+Ad4uuAN+R0oX2QSzcZqrL2RLGgblKmKTPNgvPYNbQ4Iv\nYVbiydauKypQ6UNMLXTX86bN7Rgj2Lse73kwK1ucdQfXq2yYsPRjcJlnBpnJ+V9E\naGQX8XJPi8u9ZLrCvZ8kq2Hqz+7Q6NT8p7pNP4/XDpFCFIq2RZE3gJulqP946rAj\n4147XFMkCxa8JrX/HH8lDNR9NwEuYNQ6zzr6bRooBSSLy9q6jiY3LzT2gE333Aiz\nMnqZNFe+64Vy6MYLHrSRz3Acd1FmnVUiIzaIpc/rx8I9yXeiB184FR7cnmA7i73u\n1TvxHwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBZcMeCvryUK4G1iFEWeJfxYYYD\nRxbXRw0Z5+5LikWOWsidwxu4p8WzoQYcZc+He8S8pb5mmeE1wID3K9mzchJa6RuK\nnyAL5El159RNFDXlSejlKO96rHH9wx9yNdZI443YA8R68tzXHFVujw0T4yzNa5nw\n7dDkx9hBX5gDRLSyfSUCI6JBMVWODgEtMhMp7ttHpkg7DXVGorTVPUE4jiO/8M2k\nvhmL6gXXeiTCIXB0p27xbzD3hZufTgxQXC3Hz+dZvUhV9acEJ1a6948QBrj6zW3j\n+vJ7YrcCq3J1BCY/hJj2dfAodkvWuaIzlHIyprHx7UJ0C7uzBnQe2pVaER2k\n-----END CERTIFICATE-----\n"}]': finished 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.470652+0000 mon.b (mon.2) 222 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.472947+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.478417+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi195/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDjbae0kP6GEJvm\nwrOCCIcrlxuQqjXZtSxKvn4B3i64A35HShfZBLNxmqsvZEsaBuUqYpM82C89g1tD\ngi9hVuLJ1q4rKlDpQ0wtdNfzps3tGCPYux7veTArW5x1B9erbJiw9GNwmWcGmcn5\nX0RoZBfxck+Ly71kusK9nySrYerP7tDo1Pynuk0/j9cOkUIUirZFkTeAm6Wo/3jq\nsCPjXjtcUyQLFrwmtf8cfyUM1H03AS5g1DrPOvptGigFJIvL2rqOJjcvNPaATffc\nCLMyepk0V77rhXLoxgsetJHPcBx3UWadVSIjNoilz+vHwj3Jd6IHXzgVHtyeYDuL\nve7VO/EfAgMBAAECggEAfrR42oBtTQOz17xhhfB6Xi6xjMdHeSMWqg225hOCs8I+\neDkvUBjuYDxrYtvde4Kb6iFBJoTKzNqB3fqJqxFdCFYycpoAufRkXG7cYUJtN8pb\nLkQR2BkMXRuM7yaPYVH/P5boT7MnUuYbQHNzCTW6oSmuZ5P60EO8eyhOpazHxU+a\n89el9FIRYvhiIKXhcpv4Kgq5l5KtmUhbW5wCXapZZP1fWe3RT2C0X7W+wG5qbHyy\nAoDhUooPN2PjEjqOjvu2eYfgdOlPRjZ17xlJ9hMgJBepoR4abQDx/Fp3BDBbfWdZ\nii03LBamr5jXJjLTEBlH6zaCr2heEt7mYuO7GFHvAQKBgQDz2bqQgOM5QlrvALwd\nun45hP2ScpvMdhrCOa+La8/hQ+DBzCjx0AQOA3DjAm9lg80TZjc+dOceVNnOssB7\nn7bcpKRiZSKcZtV6fh64ggZbvX67fwSrcgMgoghPbAIFhZROPBj05MyA0+mYyuFQ\nlhryqomQOZvTB91oD+PTXYFt6wKBgQDuwnbnd+RGjEhj88AJewxpai0Vq2rVhm1u\naw+kZxaamt4MYArhBOZqs1j7b0RCXXJD0aV8GsCqDR+haYRdvFWjNDtsQgnL98aY\nedpSiFAvnX7ybDl2Y/J9BBoP6nIhZJfqCa99nP/GQvuXbP2xRliz0YPjuKhpbMzp\n6F+eTMiYnQKBgFQ5Y8L9gX4JeTcL3e22uFpNoPewNjfMozlqi0NwnYCE3WCSj6HV\n41Cjx53g/XDmsTJ+H56m6h0D2acW/ny0kYhsJYsGu4mhyyJf5WR9JI0TSm6gVJCS\n9JmU3aHxAFG/7ZWIFGahkDD/ALQRfvlCn1QpqxHxk+yzzrleo6Yhqc65AoGBAII8\n96lZn97PxOko3DcPtPyHm2I3qEYjVuwlYFn4lb7t/XPYq/aEur+3ZzF4R07ANIVE\nBbYFzdS05e0hZr/O7RPieQublkZ5uQ4RYgMlMkBW9Bl+6XVoHa0OIL1P0MPgYHGc\nqOqnSmo2vZCjNluOGPK1tfDxGISxgbGSPR5XmhCNAoGBAKJfm3xXzSlCI74UauXp\n0HNb4BMMAzTvjegTNZa6QQJ2zSoqxxKy3XLXYQxGCZw5rljkAF4zytG/XZJYeh4l\nL/O4u3fT8QmT3HU+IFHT7K+bm+7IWYwPxrgrWUcmqnEmwnqflzrjOXxBzylJe7a2\nAKLt2EST32/dLcspuqts4mpa\n-----END PRIVATE KEY-----\n"}]': finished 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.481691+0000 mon.b (mon.2) 223 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.483190+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.485242+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-01-21T07:50:04.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:03 smithi195 bash[13978]: audit 2024-01-21T07:50:03.492091+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2024-01-21T07:50:05.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[13909]: audit 2024-01-21T07:50:03.209464+0000 mgr.x (mgr.34778) 37 : audit [DBG] from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:05.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[13909]: cephadm 2024-01-21T07:50:03.351676+0000 mgr.x (mgr.34778) 38 : cephadm [INF] Reconfiguring grafana.a (dependencies changed)... 2024-01-21T07:50:05.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[13909]: audit 2024-01-21T07:50:03.482640+0000 mgr.x (mgr.34778) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-21T07:50:05.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[13909]: cephadm 2024-01-21T07:50:03.500907+0000 mgr.x (mgr.34778) 40 : cephadm [INF] Reconfiguring daemon grafana.a on smithi195 2024-01-21T07:50:05.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[17460]: audit 2024-01-21T07:50:03.209464+0000 mgr.x (mgr.34778) 37 : audit [DBG] from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:05.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[17460]: cephadm 2024-01-21T07:50:03.351676+0000 mgr.x (mgr.34778) 38 : cephadm [INF] Reconfiguring grafana.a (dependencies changed)... 2024-01-21T07:50:05.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[17460]: audit 2024-01-21T07:50:03.482640+0000 mgr.x (mgr.34778) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-21T07:50:05.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:04 smithi080 bash[17460]: cephadm 2024-01-21T07:50:03.500907+0000 mgr.x (mgr.34778) 40 : cephadm [INF] Reconfiguring daemon grafana.a on smithi195 2024-01-21T07:50:05.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:04 smithi195 bash[13978]: audit 2024-01-21T07:50:03.209464+0000 mgr.x (mgr.34778) 37 : audit [DBG] from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:05.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:04 smithi195 bash[13978]: cephadm 2024-01-21T07:50:03.351676+0000 mgr.x (mgr.34778) 38 : cephadm [INF] Reconfiguring grafana.a (dependencies changed)... 2024-01-21T07:50:05.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:04 smithi195 bash[13978]: audit 2024-01-21T07:50:03.482640+0000 mgr.x (mgr.34778) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-21T07:50:05.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:04 smithi195 bash[13978]: cephadm 2024-01-21T07:50:03.500907+0000 mgr.x (mgr.34778) 40 : cephadm [INF] Reconfiguring daemon grafana.a on smithi195 2024-01-21T07:50:06.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:05 smithi080 bash[13909]: cluster 2024-01-21T07:50:04.702364+0000 mgr.x (mgr.34778) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:06.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:05 smithi080 bash[17460]: cluster 2024-01-21T07:50:04.702364+0000 mgr.x (mgr.34778) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:06.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:05 smithi195 bash[13978]: cluster 2024-01-21T07:50:04.702364+0000 mgr.x (mgr.34778) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:07.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:06 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:06] "GET /metrics HTTP/1.1" 200 152505 "" "Prometheus/2.33.4" 2024-01-21T07:50:08.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:07 smithi080 bash[13909]: cluster 2024-01-21T07:50:06.703038+0000 mgr.x (mgr.34778) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:08.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:07 smithi080 bash[17460]: cluster 2024-01-21T07:50:06.703038+0000 mgr.x (mgr.34778) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:08.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:07 smithi195 bash[13978]: cluster 2024-01-21T07:50:06.703038+0000 mgr.x (mgr.34778) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:10.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:09 smithi080 bash[13909]: cluster 2024-01-21T07:50:08.703888+0000 mgr.x (mgr.34778) 43 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:10.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:09 smithi080 bash[17460]: cluster 2024-01-21T07:50:08.703888+0000 mgr.x (mgr.34778) 43 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:10.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:09 smithi195 bash[13978]: cluster 2024-01-21T07:50:08.703888+0000 mgr.x (mgr.34778) 43 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:12.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:11 smithi080 bash[13909]: cluster 2024-01-21T07:50:10.704354+0000 mgr.x (mgr.34778) 44 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:12.309 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:12 smithi080 bash[36089]: level=info ts=2024-01-21T07:50:12.036Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.001937977s 2024-01-21T07:50:12.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:11 smithi080 bash[17460]: cluster 2024-01-21T07:50:10.704354+0000 mgr.x (mgr.34778) 44 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:12.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:11 smithi195 bash[13978]: cluster 2024-01-21T07:50:10.704354+0000 mgr.x (mgr.34778) 44 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:13.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:12 smithi080 bash[14168]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:12] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:50:14.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:13 smithi080 bash[13909]: cluster 2024-01-21T07:50:12.705111+0000 mgr.x (mgr.34778) 45 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:14.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:13 smithi080 bash[17460]: cluster 2024-01-21T07:50:12.705111+0000 mgr.x (mgr.34778) 45 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:14.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:13 smithi195 bash[13978]: cluster 2024-01-21T07:50:12.705111+0000 mgr.x (mgr.34778) 45 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:15.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:14 smithi080 bash[13909]: cluster 2024-01-21T07:50:14.706524+0000 mgr.x (mgr.34778) 46 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:15.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:14 smithi080 bash[17460]: cluster 2024-01-21T07:50:14.706524+0000 mgr.x (mgr.34778) 46 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:15.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:14 smithi195 bash[13978]: cluster 2024-01-21T07:50:14.706524+0000 mgr.x (mgr.34778) 46 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:17.037 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:16 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:16] "GET /metrics HTTP/1.1" 200 152508 "" "Prometheus/2.33.4" 2024-01-21T07:50:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:17 smithi080 bash[13909]: cluster 2024-01-21T07:50:16.707352+0000 mgr.x (mgr.34778) 47 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:18.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:17 smithi080 bash[17460]: cluster 2024-01-21T07:50:16.707352+0000 mgr.x (mgr.34778) 47 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:17 smithi195 bash[13978]: cluster 2024-01-21T07:50:16.707352+0000 mgr.x (mgr.34778) 47 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:20.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:19 smithi080 bash[13909]: cluster 2024-01-21T07:50:18.708972+0000 mgr.x (mgr.34778) 48 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:20.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:19 smithi080 bash[17460]: cluster 2024-01-21T07:50:18.708972+0000 mgr.x (mgr.34778) 48 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:20.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:19 smithi195 bash[13978]: cluster 2024-01-21T07:50:18.708972+0000 mgr.x (mgr.34778) 48 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:22.182 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:21 smithi195 bash[13978]: cluster 2024-01-21T07:50:20.709745+0000 mgr.x (mgr.34778) 49 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:22.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:21 smithi080 bash[13909]: cluster 2024-01-21T07:50:20.709745+0000 mgr.x (mgr.34778) 49 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:22.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:21 smithi080 bash[17460]: cluster 2024-01-21T07:50:20.709745+0000 mgr.x (mgr.34778) 49 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:23.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:22 smithi080 bash[14168]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:22] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:50:24.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:23 smithi195 bash[13978]: cluster 2024-01-21T07:50:22.710445+0000 mgr.x (mgr.34778) 50 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:24.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:23 smithi080 bash[13909]: cluster 2024-01-21T07:50:22.710445+0000 mgr.x (mgr.34778) 50 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:24.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:23 smithi080 bash[17460]: cluster 2024-01-21T07:50:22.710445+0000 mgr.x (mgr.34778) 50 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:25.138 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 systemd[1]: Stopping Ceph grafana.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped Stream Manager" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2024-01-21T07:50:25.139 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2024-01-21T07:50:25.140 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:24 smithi195 bash[22730]: t=2024-01-21T07:50:24+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2024-01-21T07:50:25.730 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[27534]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-grafana.a 2024-01-21T07:50:25.730 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[27570]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/grafana.a/unit.stop: No such file or directory 2024-01-21T07:50:25.730 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:25 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-01-21T07:50:25.730 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:25 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-01-21T07:50:25.730 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:25 smithi195 systemd[1]: Stopped Ceph grafana.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:50:25.730 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:25 smithi195 systemd[1]: Started Ceph grafana.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:50:25.731 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STOPPING 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STOPPED 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STARTING 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Serving on http://:::9283 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STARTED 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STOPPING 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-21T07:50:25.965 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STOPPED 2024-01-21T07:50:25.966 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STARTING 2024-01-21T07:50:25.966 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: cluster 2024-01-21T07:50:24.711938+0000 mgr.x (mgr.34778) 51 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.693037+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.695859+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.702637+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.705996+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.707646+0000 mon.b (mon.2) 227 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.708371+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.710465+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.718488+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.725362+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.731894+0000 mon.b (mon.2) 230 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi195.front.sepia.ceph.com:3000"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.734087+0000 mon.b (mon.2) 231 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:50:25.967 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.736421+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:50:25.968 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.743943+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-01-21T07:50:25.968 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.749865+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-21T07:50:25.968 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.759648+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-01-21T07:50:25.968 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.761071+0000 mon.b (mon.2) 234 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-01-21T07:50:25.968 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.763382+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-01-21T07:50:25.968 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[13978]: audit 2024-01-21T07:50:25.771347+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-01-21T07:50:26.081 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Serving on http://:::9283 2024-01-21T07:50:26.082 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STARTED 2024-01-21T07:50:26.082 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STOPPING 2024-01-21T07:50:26.082 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-21T07:50:26.082 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STOPPED 2024-01-21T07:50:26.082 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:25 smithi195 bash[24590]: [21/Jan/2024:07:50:25] ENGINE Bus STARTING 2024-01-21T07:50:26.082 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[24590]: [21/Jan/2024:07:50:26] ENGINE Serving on http://:::9283 2024-01-21T07:50:26.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: cluster 2024-01-21T07:50:24.711938+0000 mgr.x (mgr.34778) 51 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:26.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: cluster 2024-01-21T07:50:24.711938+0000 mgr.x (mgr.34778) 51 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:26.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.693037+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:26.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.693037+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:26.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.695859+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:26.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.702637+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:26.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.695859+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:26.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.702637+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 111987916, \"cpu_percentage\": \"1.04%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.678984Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 435368755, \"cpu_percentage\": \"3.08%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:49:52.679391Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51222937, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679640Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.44%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.679858Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48727326, \"cpu_percentage\": \"0.36%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680073Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51715768, \"cpu_percentage\": \"0.33%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680287Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680503Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51254394, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:52.680844Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 27053260, \"cpu_percentage\": \"0.25%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:49:52.681058Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.705996+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.707646+0000 mon.b (mon.2) 227 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.708371+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.710465+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.718488+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.725362+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.731894+0000 mon.b (mon.2) 230 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi195.front.sepia.ceph.com:3000"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.734087+0000 mon.b (mon.2) 231 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:50:26.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.736421+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.743943+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.749865+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.759648+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.761071+0000 mon.b (mon.2) 234 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.763382+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[13909]: audit 2024-01-21T07:50:25.771347+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.705996+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.707646+0000 mon.b (mon.2) 227 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.708371+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.710465+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.718488+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.725362+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-21T07:50:26.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.731894+0000 mon.b (mon.2) 230 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi195.front.sepia.ceph.com:3000"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.734087+0000 mon.b (mon.2) 231 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.736421+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.743943+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"https://smithi195.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.749865+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.759648+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.761071+0000 mon.b (mon.2) 234 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.763382+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-01-21T07:50:26.314 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:25 smithi080 bash[17460]: audit 2024-01-21T07:50:25.771347+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi195.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-01-21T07:50:26.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[24590]: [21/Jan/2024:07:50:26] ENGINE Bus STARTED 2024-01-21T07:50:26.976 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:26] "GET /metrics HTTP/1.1" 200 152508 "" "Prometheus/2.33.4" 2024-01-21T07:50:26.976 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: audit 2024-01-21T07:50:25.706498+0000 mgr.x (mgr.34778) 52 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-21T07:50:26.976 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: audit 2024-01-21T07:50:25.708003+0000 mgr.x (mgr.34778) 53 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-01-21T07:50:26.976 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: audit 2024-01-21T07:50:25.726147+0000 mgr.x (mgr.34778) 54 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-21T07:50:26.976 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: audit 2024-01-21T07:50:25.732994+0000 mgr.x (mgr.34778) 55 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi195.front.sepia.ceph.com:3000"}]: dispatch 2024-01-21T07:50:26.976 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: audit 2024-01-21T07:50:25.750864+0000 mgr.x (mgr.34778) 56 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-21T07:50:26.977 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: audit 2024-01-21T07:50:25.760359+0000 mgr.x (mgr.34778) 57 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-01-21T07:50:26.977 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[13978]: cephadm 2024-01-21T07:50:25.775257+0000 mgr.x (mgr.34778) 58 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:50:27.282 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2024-01-21T07:50:27.282 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="App mode production" logger=settings 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Initializing SqlStore" logger=server 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-01-21T07:50:27.283 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Starting DB migration" logger=migrator 2024-01-21T07:50:27.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:26 smithi195 bash[27573]: t=2024-01-21T07:50:26+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-01-21T07:50:27.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-01-21T07:50:27.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-01-21T07:50:27.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-01-21T07:50:27.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-01-21T07:50:27.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-01-21T07:50:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: audit 2024-01-21T07:50:25.706498+0000 mgr.x (mgr.34778) 52 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-21T07:50:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: audit 2024-01-21T07:50:25.708003+0000 mgr.x (mgr.34778) 53 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-01-21T07:50:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: audit 2024-01-21T07:50:25.726147+0000 mgr.x (mgr.34778) 54 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-21T07:50:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: audit 2024-01-21T07:50:25.732994+0000 mgr.x (mgr.34778) 55 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi195.front.sepia.ceph.com:3000"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: audit 2024-01-21T07:50:25.750864+0000 mgr.x (mgr.34778) 56 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: audit 2024-01-21T07:50:25.760359+0000 mgr.x (mgr.34778) 57 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[13909]: cephadm 2024-01-21T07:50:25.775257+0000 mgr.x (mgr.34778) 58 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: audit 2024-01-21T07:50:25.706498+0000 mgr.x (mgr.34778) 52 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: audit 2024-01-21T07:50:25.708003+0000 mgr.x (mgr.34778) 53 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: audit 2024-01-21T07:50:25.726147+0000 mgr.x (mgr.34778) 54 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: audit 2024-01-21T07:50:25.732994+0000 mgr.x (mgr.34778) 55 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi195.front.sepia.ceph.com:3000"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: audit 2024-01-21T07:50:25.750864+0000 mgr.x (mgr.34778) 56 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: audit 2024-01-21T07:50:25.760359+0000 mgr.x (mgr.34778) 57 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-01-21T07:50:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:26 smithi080 bash[17460]: cephadm 2024-01-21T07:50:25.775257+0000 mgr.x (mgr.34778) 58 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T07:50:27.567 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-01-21T07:50:27.567 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-01-21T07:50:27.567 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-01-21T07:50:27.567 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-01-21T07:50:27.844 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-01-21T07:50:27.844 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-01-21T07:50:27.844 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-01-21T07:50:27.844 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-01-21T07:50:27.844 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-01-21T07:50:27.844 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-01-21T07:50:28.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:27 smithi080 bash[13909]: cluster 2024-01-21T07:50:26.712671+0000 mgr.x (mgr.34778) 59 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:28.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:27 smithi080 bash[17460]: cluster 2024-01-21T07:50:26.712671+0000 mgr.x (mgr.34778) 59 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:28.130 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[13978]: cluster 2024-01-21T07:50:26.712671+0000 mgr.x (mgr.34778) 59 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:28.130 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-01-21T07:50:28.130 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:27 smithi195 bash[27573]: t=2024-01-21T07:50:27+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-01-21T07:50:28.130 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-01-21T07:50:28.130 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-01-21T07:50:28.130 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-01-21T07:50:28.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-01-21T07:50:28.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-01-21T07:50:28.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-01-21T07:50:28.675 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-01-21T07:50:28.675 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-01-21T07:50:28.675 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-01-21T07:50:28.676 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-01-21T07:50:28.676 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-01-21T07:50:28.927 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-01-21T07:50:28.927 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-01-21T07:50:28.927 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-01-21T07:50:29.187 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[27573]: t=2024-01-21T07:50:28+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-01-21T07:50:29.187 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-01-21T07:50:29.187 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-01-21T07:50:29.187 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.941251+0000 mon.b (mon.2) 235 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.941738+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.942007+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.942227+0000 mon.b (mon.2) 238 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.943519+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.944646+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.945124+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:27.945629+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.214362+0000 mon.b (mon.2) 239 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-01-21T07:50:29.188 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.216825+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-01-21T07:50:29.189 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.222770+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-01-21T07:50:29.189 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.226353+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:29.189 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.229510+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:29.189 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.231553+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:29.189 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:28 smithi195 bash[13978]: audit 2024-01-21T07:50:28.237919+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-01-21T07:50:29.215 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.941251+0000 mon.b (mon.2) 235 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-01-21T07:50:29.215 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.941738+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.215 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.942007+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.942227+0000 mon.b (mon.2) 238 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.943519+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.944646+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.945124+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:27.945629+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.214362+0000 mon.b (mon.2) 239 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.216825+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.941251+0000 mon.b (mon.2) 235 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.941738+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.216 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.942007+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.942227+0000 mon.b (mon.2) 238 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.943519+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.944646+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.945124+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:27.945629+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.214362+0000 mon.b (mon.2) 239 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.216825+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.222770+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.226353+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.229510+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:29.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.231553+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:29.218 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[13909]: audit 2024-01-21T07:50:28.237919+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-01-21T07:50:29.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.222770+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"progress_id\": \"33564abf-1b01-43d0-a29a-d4814f33c752\", \"target_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"target_version\": \"16.2.14-454-gea310589\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-01-21T07:50:29.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.226353+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:29.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.229510+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:29.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.231553+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:29.218 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:28 smithi080 bash[17460]: audit 2024-01-21T07:50:28.237919+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-01-21T07:50:29.438 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-01-21T07:50:29.439 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-01-21T07:50:29.439 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-01-21T07:50:29.439 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-01-21T07:50:29.762 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-01-21T07:50:29.762 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-01-21T07:50:29.762 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-01-21T07:50:29.762 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-01-21T07:50:29.762 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-01-21T07:50:29.762 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-01-21T07:50:30.068 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-01-21T07:50:30.068 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-01-21T07:50:30.068 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[27573]: t=2024-01-21T07:50:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-01-21T07:50:30.069 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-01-21T07:50:30.069 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[13978]: cephadm 2024-01-21T07:50:28.222593+0000 mgr.x (mgr.34778) 60 : cephadm [INF] Upgrade: Target is version 16.2.14-454-gea310589 (pacific) 2024-01-21T07:50:30.069 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[13978]: cephadm 2024-01-21T07:50:28.223044+0000 mgr.x (mgr.34778) 61 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24'] 2024-01-21T07:50:30.069 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[13978]: cephadm 2024-01-21T07:50:28.245721+0000 mgr.x (mgr.34778) 62 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:30.069 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[13978]: cephadm 2024-01-21T07:50:28.253107+0000 mgr.x (mgr.34778) 63 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:30.069 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:29 smithi195 bash[13978]: cluster 2024-01-21T07:50:28.714250+0000 mgr.x (mgr.34778) 64 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:30.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[13909]: cephadm 2024-01-21T07:50:28.222593+0000 mgr.x (mgr.34778) 60 : cephadm [INF] Upgrade: Target is version 16.2.14-454-gea310589 (pacific) 2024-01-21T07:50:30.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[13909]: cephadm 2024-01-21T07:50:28.223044+0000 mgr.x (mgr.34778) 61 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24'] 2024-01-21T07:50:30.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[13909]: cephadm 2024-01-21T07:50:28.245721+0000 mgr.x (mgr.34778) 62 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[13909]: cephadm 2024-01-21T07:50:28.253107+0000 mgr.x (mgr.34778) 63 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[13909]: cluster 2024-01-21T07:50:28.714250+0000 mgr.x (mgr.34778) 64 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[17460]: cephadm 2024-01-21T07:50:28.222593+0000 mgr.x (mgr.34778) 60 : cephadm [INF] Upgrade: Target is version 16.2.14-454-gea310589 (pacific) 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[17460]: cephadm 2024-01-21T07:50:28.223044+0000 mgr.x (mgr.34778) 61 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24'] 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[17460]: cephadm 2024-01-21T07:50:28.245721+0000 mgr.x (mgr.34778) 62 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[17460]: cephadm 2024-01-21T07:50:28.253107+0000 mgr.x (mgr.34778) 63 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:30.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:29 smithi080 bash[17460]: cluster 2024-01-21T07:50:28.714250+0000 mgr.x (mgr.34778) 64 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:30.323 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-01-21T07:50:30.323 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-01-21T07:50:30.323 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-01-21T07:50:30.631 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-01-21T07:50:30.631 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-01-21T07:50:30.631 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-01-21T07:50:30.631 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-01-21T07:50:30.631 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-01-21T07:50:30.631 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-01-21T07:50:30.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-01-21T07:50:30.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-01-21T07:50:30.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-01-21T07:50:31.206 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-01-21T07:50:31.207 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[27573]: t=2024-01-21T07:50:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-01-21T07:50:31.207 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-01-21T07:50:31.207 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-01-21T07:50:31.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.128782+0000 mon.b (mon.2) 242 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]: dispatch 2024-01-21T07:50:31.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.131195+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]: dispatch 2024-01-21T07:50:31.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.139615+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]': finished 2024-01-21T07:50:31.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.140508+0000 mon.b (mon.2) 243 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:50:31.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.142821+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:50:31.208 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.143014+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:50:31.208 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.144283+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:50:31.208 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:30 smithi195 bash[13978]: audit 2024-01-21T07:50:30.146065+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.128782+0000 mon.b (mon.2) 242 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.131195+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.139615+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]': finished 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.140508+0000 mon.b (mon.2) 243 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.142821+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.143014+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.144283+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[13909]: audit 2024-01-21T07:50:30.146065+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.128782+0000 mon.b (mon.2) 242 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]: dispatch 2024-01-21T07:50:31.213 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.131195+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]: dispatch 2024-01-21T07:50:31.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.139615+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr.y"}]': finished 2024-01-21T07:50:31.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.140508+0000 mon.b (mon.2) 243 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:50:31.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.142821+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:50:31.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.143014+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:50:31.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.144283+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:50:31.214 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:30 smithi080 bash[17460]: audit 2024-01-21T07:50:30.146065+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-01-21T07:50:31.519 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-01-21T07:50:31.519 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-01-21T07:50:31.519 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-01-21T07:50:31.519 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-01-21T07:50:31.519 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-01-21T07:50:31.819 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-01-21T07:50:31.819 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-01-21T07:50:31.819 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-01-21T07:50:31.819 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-01-21T07:50:31.819 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-01-21T07:50:32.095 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-01-21T07:50:32.095 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-01-21T07:50:32.096 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[27573]: t=2024-01-21T07:50:31+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-01-21T07:50:32.096 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-01-21T07:50:32.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[13978]: cephadm 2024-01-21T07:50:30.127793+0000 mgr.x (mgr.34778) 65 : cephadm [INF] Upgrade: Updating mgr.y 2024-01-21T07:50:32.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[13978]: cephadm 2024-01-21T07:50:30.145491+0000 mgr.x (mgr.34778) 66 : cephadm [INF] Deploying daemon mgr.y on smithi080 2024-01-21T07:50:32.096 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:31 smithi195 bash[13978]: cluster 2024-01-21T07:50:30.715108+0000 mgr.x (mgr.34778) 67 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:32.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:32 smithi080 systemd[1]: Stopping Ceph mgr.y for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:50:32.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:31 smithi080 bash[13909]: cephadm 2024-01-21T07:50:30.127793+0000 mgr.x (mgr.34778) 65 : cephadm [INF] Upgrade: Updating mgr.y 2024-01-21T07:50:32.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:31 smithi080 bash[13909]: cephadm 2024-01-21T07:50:30.145491+0000 mgr.x (mgr.34778) 66 : cephadm [INF] Deploying daemon mgr.y on smithi080 2024-01-21T07:50:32.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:31 smithi080 bash[13909]: cluster 2024-01-21T07:50:30.715108+0000 mgr.x (mgr.34778) 67 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:32.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:31 smithi080 bash[17460]: cephadm 2024-01-21T07:50:30.127793+0000 mgr.x (mgr.34778) 65 : cephadm [INF] Upgrade: Updating mgr.y 2024-01-21T07:50:32.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:31 smithi080 bash[17460]: cephadm 2024-01-21T07:50:30.145491+0000 mgr.x (mgr.34778) 66 : cephadm [INF] Deploying daemon mgr.y on smithi080 2024-01-21T07:50:32.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:31 smithi080 bash[17460]: cluster 2024-01-21T07:50:30.715108+0000 mgr.x (mgr.34778) 67 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:32.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-01-21T07:50:32.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-01-21T07:50:32.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-01-21T07:50:32.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-01-21T07:50:32.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-01-21T07:50:32.665 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-01-21T07:50:32.665 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-01-21T07:50:32.665 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-01-21T07:50:32.665 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-01-21T07:50:32.665 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-01-21T07:50:32.925 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-01-21T07:50:32.925 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-01-21T07:50:32.925 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-01-21T07:50:33.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:32 smithi080 bash[14168]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:32] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:50:33.210 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-01-21T07:50:33.210 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:32 smithi195 bash[27573]: t=2024-01-21T07:50:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-01-21T07:50:33.211 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-01-21T07:50:33.211 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-01-21T07:50:33.211 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-01-21T07:50:33.512 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-01-21T07:50:33.512 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-01-21T07:50:33.512 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-01-21T07:50:33.608 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:50:33.796 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-01-21T07:50:33.797 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-01-21T07:50:33.797 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-01-21T07:50:33.797 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-01-21T07:50:33.797 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-01-21T07:50:34.090 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-01-21T07:50:34.090 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[27573]: t=2024-01-21T07:50:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-01-21T07:50:34.090 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-01-21T07:50:34.091 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:33 smithi195 bash[13978]: cluster 2024-01-21T07:50:32.715898+0000 mgr.x (mgr.34778) 68 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:34.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:33 smithi080 bash[13909]: cluster 2024-01-21T07:50:32.715898+0000 mgr.x (mgr.34778) 68 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:34.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:33 smithi080 bash[17460]: cluster 2024-01-21T07:50:32.715898+0000 mgr.x (mgr.34778) 68 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:34.349 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:alertmanager.a smithi080 *:9093,9094 starting - - - - 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 starting - - - - 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (2m) 41s ago 11m 415M - 16.2.14-454-gea310589 9b28eb2d7c37 82dc6695abd6 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 running (13m) 59s ago 13m 288M - 15.2.0 204a01f9b0b6 49ff7d975d43 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (13m) 59s ago 13m 108M 2048M 15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (11m) 41s ago 11m 106M 2048M 15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (12m) 59s ago 12m 102M 2048M 15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 59s ago 8m - - 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 41s ago 8m - - 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (11m) 59s ago 11m 50.4M 4096M 15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (10m) 59s ago 10m 50.9M 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (10m) 59s ago 10m 44.9M 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (10m) 59s ago 10m 47.2M 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (9m) 41s ago 9m 48.8M 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:50:34.350 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (9m) 41s ago 9m 47.4M 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:50:34.351 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (8m) 41s ago 8m 46.4M 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:50:34.351 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (8m) 41s ago 8m 49.3M 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:50:34.351 INFO:teuthology.orchestra.run.smithi080.stdout:prometheus.a smithi195 *:9095 running (47s) 41s ago 47s 25.7M - 2.33.4 514e6a882f6e 9c7157bf1685 2024-01-21T07:50:34.351 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (5m) 59s ago 5m 49.2M - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:50:34.351 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (5m) 41s ago 5m 48.8M - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:50:34.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-01-21T07:50:34.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-01-21T07:50:34.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-01-21T07:50:34.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-01-21T07:50:34.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-01-21T07:50:34.678 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-01-21T07:50:34.678 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-01-21T07:50:34.678 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-01-21T07:50:34.678 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-01-21T07:50:34.678 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:50:34.773 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:50:34.774 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:50:34.937 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-01-21T07:50:34.937 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-01-21T07:50:34.937 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-01-21T07:50:35.143 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:50:35.143 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", 2024-01-21T07:50:35.143 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:50:35.143 INFO:teuthology.orchestra.run.smithi080.stdout: "which": "Upgrading all daemon types on all hosts", 2024-01-21T07:50:35.144 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [], 2024-01-21T07:50:35.144 INFO:teuthology.orchestra.run.smithi080.stdout: "progress": "1/20 daemons upgraded", 2024-01-21T07:50:35.144 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "Currently upgrading mgr daemons", 2024-01-21T07:50:35.144 INFO:teuthology.orchestra.run.smithi080.stdout: "is_paused": false 2024-01-21T07:50:35.144 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:50:35.206 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[27573]: t=2024-01-21T07:50:34+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-01-21T07:50:35.206 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-01-21T07:50:35.206 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-01-21T07:50:35.206 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-01-21T07:50:35.206 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-01-21T07:50:35.206 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:33.591595+0000 mgr.x (mgr.34778) 69 : audit [DBG] from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:35.206 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.321107+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.206 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.322257+0000 mon.b (mon.2) 248 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.206 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.323395+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.206 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.324301+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.325248+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.326286+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.331444+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.332252+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.333019+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.333795+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.334531+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.207 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:34 smithi195 bash[13978]: audit 2024-01-21T07:50:34.771198+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/2448666429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:50:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:33.591595+0000 mgr.x (mgr.34778) 69 : audit [DBG] from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.321107+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.322257+0000 mon.b (mon.2) 248 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.323395+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.324301+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.325248+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.326286+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.331444+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.332252+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.333019+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.333795+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.334531+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[13909]: audit 2024-01-21T07:50:34.771198+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/2448666429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:33.591595+0000 mgr.x (mgr.34778) 69 : audit [DBG] from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.321107+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.322257+0000 mon.b (mon.2) 248 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.312 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.323395+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.324301+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.325248+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.326286+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.331444+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.332252+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.333019+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.333795+0000 mon.b (mon.2) 256 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.334531+0000 mon.b (mon.2) 257 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:50:35.313 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:34 smithi080 bash[17460]: audit 2024-01-21T07:50:34.771198+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/2448666429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:50:35.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-01-21T07:50:35.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-01-21T07:50:35.457 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-01-21T07:50:35.719 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-01-21T07:50:35.719 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-01-21T07:50:35.719 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-01-21T07:50:35.719 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-01-21T07:50:35.719 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-01-21T07:50:35.986 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-01-21T07:50:35.986 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-01-21T07:50:35.986 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-01-21T07:50:35.986 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[13978]: audit 2024-01-21T07:50:33.963624+0000 mgr.x (mgr.34778) 70 : audit [DBG] from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:35.986 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[13978]: audit 2024-01-21T07:50:34.315745+0000 mgr.x (mgr.34778) 71 : audit [DBG] from='client.24904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:35.986 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[13978]: cluster 2024-01-21T07:50:34.717388+0000 mgr.x (mgr.34778) 72 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:36.245 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:35 smithi195 bash[27573]: t=2024-01-21T07:50:35+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-01-21T07:50:36.245 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-01-21T07:50:36.245 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-01-21T07:50:36.245 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-01-21T07:50:36.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:35 smithi080 bash[13909]: audit 2024-01-21T07:50:33.963624+0000 mgr.x (mgr.34778) 70 : audit [DBG] from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:36.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:35 smithi080 bash[13909]: audit 2024-01-21T07:50:34.315745+0000 mgr.x (mgr.34778) 71 : audit [DBG] from='client.24904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:36.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:35 smithi080 bash[13909]: cluster 2024-01-21T07:50:34.717388+0000 mgr.x (mgr.34778) 72 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:36.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:35 smithi080 bash[17460]: audit 2024-01-21T07:50:33.963624+0000 mgr.x (mgr.34778) 70 : audit [DBG] from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:36.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:35 smithi080 bash[17460]: audit 2024-01-21T07:50:34.315745+0000 mgr.x (mgr.34778) 71 : audit [DBG] from='client.24904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:36.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:35 smithi080 bash[17460]: cluster 2024-01-21T07:50:34.717388+0000 mgr.x (mgr.34778) 72 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:36.572 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-01-21T07:50:36.572 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-01-21T07:50:36.572 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-01-21T07:50:36.572 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-01-21T07:50:36.573 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-01-21T07:50:36.857 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:36] "GET /metrics HTTP/1.1" 200 152506 "" "Prometheus/2.33.4" 2024-01-21T07:50:36.857 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-01-21T07:50:36.857 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-01-21T07:50:36.857 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-01-21T07:50:36.857 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-01-21T07:50:37.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[13978]: audit 2024-01-21T07:50:35.139463+0000 mgr.x (mgr.34778) 73 : audit [DBG] from='client.24916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:37.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[13978]: cluster 2024-01-21T07:50:36.718185+0000 mgr.x (mgr.34778) 74 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:37.135 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:36 smithi195 bash[27573]: t=2024-01-21T07:50:36+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-01-21T07:50:37.135 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-01-21T07:50:37.135 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-01-21T07:50:37.135 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-01-21T07:50:37.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:36 smithi080 bash[13909]: audit 2024-01-21T07:50:35.139463+0000 mgr.x (mgr.34778) 73 : audit [DBG] from='client.24916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:37.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:36 smithi080 bash[13909]: cluster 2024-01-21T07:50:36.718185+0000 mgr.x (mgr.34778) 74 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:37.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:36 smithi080 bash[17460]: audit 2024-01-21T07:50:35.139463+0000 mgr.x (mgr.34778) 73 : audit [DBG] from='client.24916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:50:37.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:36 smithi080 bash[17460]: cluster 2024-01-21T07:50:36.718185+0000 mgr.x (mgr.34778) 74 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:37.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-01-21T07:50:37.388 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-01-21T07:50:37.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-01-21T07:50:37.389 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-01-21T07:50:37.704 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-01-21T07:50:37.704 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-01-21T07:50:37.704 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-01-21T07:50:37.704 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-01-21T07:50:38.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-01-21T07:50:38.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-01-21T07:50:38.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-01-21T07:50:38.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:37 smithi195 bash[27573]: t=2024-01-21T07:50:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-01-21T07:50:38.014 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-01-21T07:50:38.282 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-01-21T07:50:38.282 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-01-21T07:50:38.282 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-01-21T07:50:38.533 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-01-21T07:50:38.534 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-01-21T07:50:38.534 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-01-21T07:50:38.534 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-01-21T07:50:38.534 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-01-21T07:50:38.785 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-01-21T07:50:38.785 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-01-21T07:50:38.785 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-01-21T07:50:39.095 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-01-21T07:50:39.095 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-01-21T07:50:39.095 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:38 smithi195 bash[27573]: t=2024-01-21T07:50:38+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-01-21T07:50:39.096 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-01-21T07:50:39.096 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-01-21T07:50:39.355 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-01-21T07:50:39.355 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-01-21T07:50:39.355 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-01-21T07:50:39.615 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-01-21T07:50:39.615 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-01-21T07:50:39.615 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-01-21T07:50:39.615 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-01-21T07:50:39.615 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-01-21T07:50:39.888 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-01-21T07:50:39.888 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-01-21T07:50:39.888 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-01-21T07:50:40.219 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[13978]: cluster 2024-01-21T07:50:38.719668+0000 mgr.x (mgr.34778) 75 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:40.219 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:39 smithi195 bash[27573]: t=2024-01-21T07:50:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-01-21T07:50:40.219 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-01-21T07:50:40.220 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-01-21T07:50:40.220 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-01-21T07:50:40.220 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-01-21T07:50:40.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:39 smithi080 bash[13909]: cluster 2024-01-21T07:50:38.719668+0000 mgr.x (mgr.34778) 75 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:40.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:39 smithi080 bash[17460]: cluster 2024-01-21T07:50:38.719668+0000 mgr.x (mgr.34778) 75 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:40.470 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-01-21T07:50:40.470 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-01-21T07:50:40.470 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-01-21T07:50:40.722 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-01-21T07:50:40.722 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-01-21T07:50:40.722 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-01-21T07:50:40.722 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-01-21T07:50:41.032 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-01-21T07:50:41.032 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-01-21T07:50:41.032 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-01-21T07:50:41.032 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:40 smithi195 bash[27573]: t=2024-01-21T07:50:40+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-01-21T07:50:41.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-01-21T07:50:41.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-01-21T07:50:41.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-01-21T07:50:41.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-01-21T07:50:41.284 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-01-21T07:50:41.577 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-01-21T07:50:41.577 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-01-21T07:50:41.577 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-01-21T07:50:41.577 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-01-21T07:50:41.836 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-01-21T07:50:41.837 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-01-21T07:50:41.837 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-01-21T07:50:42.089 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[13978]: cluster 2024-01-21T07:50:40.720397+0000 mgr.x (mgr.34778) 76 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:42.089 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-01-21T07:50:42.089 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-01-21T07:50:42.089 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:41 smithi195 bash[27573]: t=2024-01-21T07:50:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-01-21T07:50:42.089 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-01-21T07:50:42.090 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-01-21T07:50:42.276 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:41 smithi080 bash[13909]: cluster 2024-01-21T07:50:40.720397+0000 mgr.x (mgr.34778) 76 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:42.276 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:41 smithi080 bash[17460]: cluster 2024-01-21T07:50:40.720397+0000 mgr.x (mgr.34778) 76 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:42.382 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-01-21T07:50:42.382 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-01-21T07:50:42.382 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-01-21T07:50:42.383 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-01-21T07:50:42.383 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-01-21T07:50:42.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-01-21T07:50:42.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing HTTPServer" logger=server 2024-01-21T07:50:42.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing PluginManager" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Starting plugin search" logger=plugins 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing HooksService" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing RemoteCache" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing QuotaService" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing ServerLockService" logger=server 2024-01-21T07:50:42.640 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing RenderingService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing AlertEngine" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing LoginService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing SearchService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing TracingService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing CleanUpService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing NotificationService" logger=server 2024-01-21T07:50:42.641 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2024-01-21T07:50:42.642 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-01-21T07:50:42.642 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2024-01-21T07:50:42.642 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2024-01-21T07:50:42.642 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2024-01-21T07:50:42.642 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="Initializing Stream Manager" 2024-01-21T07:50:42.642 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:50:42 smithi195 bash[27573]: t=2024-01-21T07:50:42+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-01-21T07:50:43.209 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:42 smithi080 bash[36612]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.y 2024-01-21T07:50:43.209 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:43 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service: Main process exited, code=exited, status=137/n/a 2024-01-21T07:50:43.209 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[36805]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.y 2024-01-21T07:50:43.513 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:43 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-01-21T07:50:43.513 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:43 smithi080 systemd[1]: Stopped Ceph mgr.y for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:50:43.513 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:43 smithi080 systemd[1]: Started Ceph mgr.y for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:50:44.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: cluster 2024-01-21T07:50:42.721159+0000 mgr.x (mgr.34778) 77 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:44.244 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: cluster 2024-01-21T07:50:42.721159+0000 mgr.x (mgr.34778) 77 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:44.244 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: audit 2024-01-21T07:50:43.474498+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:44.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: audit 2024-01-21T07:50:43.474498+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:44.245 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: audit 2024-01-21T07:50:43.477199+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: audit 2024-01-21T07:50:43.477199+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: audit 2024-01-21T07:50:43.481363+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: audit 2024-01-21T07:50:43.484131+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: audit 2024-01-21T07:50:43.488000+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[13909]: audit 2024-01-21T07:50:43.488595+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: audit 2024-01-21T07:50:43.481363+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: audit 2024-01-21T07:50:43.484131+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: audit 2024-01-21T07:50:43.488000+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:44.246 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:43 smithi080 bash[17460]: audit 2024-01-21T07:50:43.488595+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:44.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: cluster 2024-01-21T07:50:42.721159+0000 mgr.x (mgr.34778) 77 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: audit 2024-01-21T07:50:43.474498+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: audit 2024-01-21T07:50:43.477199+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: audit 2024-01-21T07:50:43.481363+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 113560780, \"cpu_percentage\": \"2.27%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.368828Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107374182, \"cpu_percentage\": \"1.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369599Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52879687, \"cpu_percentage\": \"2.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.369950Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53383004, \"cpu_percentage\": \"2.95%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370196Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47143976, \"cpu_percentage\": \"2.25%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370430Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49513758, \"cpu_percentage\": \"2.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370662Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.370922Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51663339, \"cpu_percentage\": \"0.28%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:49:34.371089Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [9093, 9094]}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: audit 2024-01-21T07:50:43.484131+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: audit 2024-01-21T07:50:43.488000+0000 mon.b (mon.2) 260 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:44.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:43 smithi195 bash[13978]: audit 2024-01-21T07:50:43.488595+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:44.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:44 smithi080 bash[36089]: level=warn ts=2024-01-21T07:50:44.241Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:50:44.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:44 smithi080 bash[36925]: debug 2024-01-21T07:50:44.449+0000 7ff62dca3700 1 -- 172.21.15.80:0/2664473997 <== mon.1 v2:172.21.15.80:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5619d9b464e0 con 0x5619d9c3a800 2024-01-21T07:50:45.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:44 smithi080 bash[36925]: debug 2024-01-21T07:50:44.613+0000 7ff63e29e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:50:45.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:44 smithi080 bash[36925]: debug 2024-01-21T07:50:44.717+0000 7ff63e29e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:50:45.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:45 smithi080 bash[36925]: debug 2024-01-21T07:50:45.165+0000 7ff63e29e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:50:46.175 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:45 smithi080 bash[13909]: cluster 2024-01-21T07:50:44.722423+0000 mgr.x (mgr.34778) 78 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:46.176 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:46 smithi080 bash[36925]: debug 2024-01-21T07:50:46.077+0000 7ff63e29e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:50:46.176 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:45 smithi080 bash[17460]: cluster 2024-01-21T07:50:44.722423+0000 mgr.x (mgr.34778) 78 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:46.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:45 smithi195 bash[13978]: cluster 2024-01-21T07:50:44.722423+0000 mgr.x (mgr.34778) 78 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:46.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:46 smithi080 bash[36925]: debug 2024-01-21T07:50:46.169+0000 7ff63e29e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:50:46.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:46 smithi080 bash[36925]: debug 2024-01-21T07:50:46.417+0000 7ff63e29e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:50:47.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:46 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:46] "GET /metrics HTTP/1.1" 200 152509 "" "Prometheus/2.33.4" 2024-01-21T07:50:47.800 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:47 smithi080 bash[36925]: debug 2024-01-21T07:50:47.537+0000 7ff63e29e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:50:47.800 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:47 smithi080 bash[36925]: debug 2024-01-21T07:50:47.697+0000 7ff63e29e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:50:48.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:47 smithi080 bash[13909]: cluster 2024-01-21T07:50:46.723172+0000 mgr.x (mgr.34778) 79 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:48.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:47 smithi080 bash[17460]: cluster 2024-01-21T07:50:46.723172+0000 mgr.x (mgr.34778) 79 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:48.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:47 smithi080 bash[36925]: debug 2024-01-21T07:50:47.797+0000 7ff63e29e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:50:48.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:47 smithi080 bash[36925]: debug 2024-01-21T07:50:47.909+0000 7ff63e29e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:50:48.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:47 smithi195 bash[13978]: cluster 2024-01-21T07:50:46.723172+0000 mgr.x (mgr.34778) 79 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:48.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:48 smithi080 bash[36925]: debug 2024-01-21T07:50:48.129+0000 7ff63e29e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:50:48.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:48 smithi080 bash[36925]: debug 2024-01-21T07:50:48.509+0000 7ff63e29e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:50:48.808 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:48 smithi080 bash[36925]: debug 2024-01-21T07:50:48.629+0000 7ff63e29e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:50:49.922 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[36925]: debug 2024-01-21T07:50:49.581+0000 7ff63e29e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:50:49.922 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[36925]: debug 2024-01-21T07:50:49.689+0000 7ff63e29e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:50:49.922 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[36925]: debug 2024-01-21T07:50:49.805+0000 7ff63e29e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:50:49.926 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: cluster 2024-01-21T07:50:48.724650+0000 mgr.x (mgr.34778) 80 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:49.926 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: audit 2024-01-21T07:50:49.432605+0000 mon.b (mon.2) 262 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: audit 2024-01-21T07:50:49.435152+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: audit 2024-01-21T07:50:49.438526+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:49.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: audit 2024-01-21T07:50:49.718750+0000 mon.b (mon.2) 263 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: audit 2024-01-21T07:50:49.721524+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[13909]: audit 2024-01-21T07:50:49.726914+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:49.929 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: cluster 2024-01-21T07:50:48.724650+0000 mgr.x (mgr.34778) 80 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:49.929 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: audit 2024-01-21T07:50:49.432605+0000 mon.b (mon.2) 262 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.929 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: audit 2024-01-21T07:50:49.435152+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.929 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: audit 2024-01-21T07:50:49.438526+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:49.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: audit 2024-01-21T07:50:49.718750+0000 mon.b (mon.2) 263 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: audit 2024-01-21T07:50:49.721524+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:49.930 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:49 smithi080 bash[17460]: audit 2024-01-21T07:50:49.726914+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:50.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[36925]: debug 2024-01-21T07:50:50.033+0000 7ff63e29e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:50:50.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: cluster 2024-01-21T07:50:48.724650+0000 mgr.x (mgr.34778) 80 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:50.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: audit 2024-01-21T07:50:49.432605+0000 mon.b (mon.2) 262 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:50.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: audit 2024-01-21T07:50:49.435152+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:50.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: audit 2024-01-21T07:50:49.438526+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102068387, \"cpu_percentage\": \"1.37%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.429889Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 92390031, \"cpu_percentage\": \"100.84%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:50:49.430086Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430199Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53351546, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430303Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53917777, \"cpu_percentage\": \"0.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430405Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47311749, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430506Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49891246, \"cpu_percentage\": \"0.69%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430609Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430710Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51904512, \"cpu_percentage\": \"0.35%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.430771Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15602810, \"cpu_percentage\": \"0.11%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:50:49.430872Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.431065Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:50.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: audit 2024-01-21T07:50:49.718750+0000 mon.b (mon.2) 263 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:50.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: audit 2024-01-21T07:50:49.721524+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]: dispatch 2024-01-21T07:50:50.392 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:49 smithi195 bash[13978]: audit 2024-01-21T07:50:49.726914+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112407347, \"cpu_percentage\": \"0.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715774Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 448685670, \"cpu_percentage\": \"3.10%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.715975Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51757711, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716089Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49849303, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716197Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716303Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51873054, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716409Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716517Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 23980933, \"cpu_percentage\": \"1.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716582Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51443138, \"cpu_percentage\": \"0.26%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:50:49.716687Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 36857446, \"cpu_percentage\": \"0.43%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:50:49.716792Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:50:49.716971Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}}"}]': finished 2024-01-21T07:50:50.663 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[36925]: debug 2024-01-21T07:50:50.321+0000 7ff63e29e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:50:50.663 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[36925]: debug 2024-01-21T07:50:50.489+0000 7ff63e29e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:50:50.664 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[36925]: debug 2024-01-21T07:50:50.657+0000 7ff63e29e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:50:50.926 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[36925]: debug 2024-01-21T07:50:50.869+0000 7ff63e29e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:50:51.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:49.991388+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:50:51.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:49.994131+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:50:51.222 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.001310+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.010108+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.012010+0000 mon.b (mon.2) 266 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.014375+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.021506+0000 mon.b (mon.2) 267 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.023877+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.032390+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: cluster 2024-01-21T07:50:50.032528+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.035894+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.036051+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:50 smithi195 bash[13978]: audit 2024-01-21T07:50:50.037922+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:50:51.223 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: debug 2024-01-21T07:50:51.009+0000 7f28a4ea7700 -1 mgr handle_mgr_map I was active but no longer am 2024-01-21T07:50:51.224 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: ignoring --setuser ceph since I am not root 2024-01-21T07:50:51.224 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: ignoring --setgroup ceph since I am not root 2024-01-21T07:50:51.224 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: debug 2024-01-21T07:50:51.057+0000 7f4729b17700 1 -- 172.21.15.195:0/1776013252 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558d699924e0 con 0x558d69a86c00 2024-01-21T07:50:51.224 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: debug 2024-01-21T07:50:51.213+0000 7f4739cf4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:50:51.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[36925]: debug 2024-01-21T07:50:50.973+0000 7ff63e29e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:50:51.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[36925]: [21/Jan/2024:07:50:51] ENGINE Bus STARTING 2024-01-21T07:50:51.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[36925]: CherryPy Checker: 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[36925]: The Application mounted at '' has an empty config. 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[36925]: [21/Jan/2024:07:50:51] ENGINE Serving on http://:::9283 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[36925]: [21/Jan/2024:07:50:51] ENGINE Bus STARTED 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:49.991388+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:49.994131+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.001310+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.010108+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.012010+0000 mon.b (mon.2) 266 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.014375+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:51.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.021506+0000 mon.b (mon.2) 267 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.023877+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.032390+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: cluster 2024-01-21T07:50:50.032528+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.035894+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.036051+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[13909]: audit 2024-01-21T07:50:50.037922+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:49.991388+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:49.994131+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.001310+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.010108+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.012010+0000 mon.b (mon.2) 266 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:51.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.014375+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.021506+0000 mon.b (mon.2) 267 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.023877+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.032390+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: cluster 2024-01-21T07:50:50.032528+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.035894+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.34778 172.21.15.195:0/28242176' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.036051+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:50:51.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:50 smithi080 bash[17460]: audit 2024-01-21T07:50:50.037922+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:50:51.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: debug 2024-01-21T07:50:51.325+0000 7f4739cf4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:50:52.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[24590]: debug 2024-01-21T07:50:51.776+0000 7f4739cf4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cluster 2024-01-21T07:50:49.990283+0000 mgr.x (mgr.34778) 81 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cluster 2024-01-21T07:50:49.990865+0000 mgr.x (mgr.34778) 82 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cephadm 2024-01-21T07:50:50.014606+0000 mgr.x (mgr.34778) 83 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cephadm 2024-01-21T07:50:50.015732+0000 mgr.x (mgr.34778) 84 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cephadm 2024-01-21T07:50:50.020882+0000 mgr.x (mgr.34778) 85 : cephadm [INF] Failing over to other MGR 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cluster 2024-01-21T07:50:50.997140+0000 mon.a (mon.0) 701 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cluster 2024-01-21T07:50:50.998307+0000 mon.a (mon.0) 702 : cluster [INF] Activating manager daemon y 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: audit 2024-01-21T07:50:50.999520+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: audit 2024-01-21T07:50:51.008046+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cluster 2024-01-21T07:50:51.008244+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-01-21T07:50:52.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: audit 2024-01-21T07:50:51.008533+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:52.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: audit 2024-01-21T07:50:51.014680+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-01-21T07:50:52.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: cluster 2024-01-21T07:50:51.014784+0000 mon.a (mon.0) 706 : cluster [DBG] mgrmap e26: y(active, starting, since 0.0167908s) 2024-01-21T07:50:52.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: audit 2024-01-21T07:50:51.015805+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-21T07:50:52.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:51 smithi195 bash[13978]: audit 2024-01-21T07:50:51.016146+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cluster 2024-01-21T07:50:49.990283+0000 mgr.x (mgr.34778) 81 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cluster 2024-01-21T07:50:49.990865+0000 mgr.x (mgr.34778) 82 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cephadm 2024-01-21T07:50:50.014606+0000 mgr.x (mgr.34778) 83 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cephadm 2024-01-21T07:50:50.015732+0000 mgr.x (mgr.34778) 84 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cephadm 2024-01-21T07:50:50.020882+0000 mgr.x (mgr.34778) 85 : cephadm [INF] Failing over to other MGR 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cluster 2024-01-21T07:50:50.997140+0000 mon.a (mon.0) 701 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cluster 2024-01-21T07:50:50.998307+0000 mon.a (mon.0) 702 : cluster [INF] Activating manager daemon y 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: audit 2024-01-21T07:50:50.999520+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: audit 2024-01-21T07:50:51.008046+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cluster 2024-01-21T07:50:51.008244+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: audit 2024-01-21T07:50:51.008533+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: audit 2024-01-21T07:50:51.014680+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-01-21T07:50:52.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: cluster 2024-01-21T07:50:51.014784+0000 mon.a (mon.0) 706 : cluster [DBG] mgrmap e26: y(active, starting, since 0.0167908s) 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: audit 2024-01-21T07:50:51.015805+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[13909]: audit 2024-01-21T07:50:51.016146+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cluster 2024-01-21T07:50:49.990283+0000 mgr.x (mgr.34778) 81 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cluster 2024-01-21T07:50:49.990865+0000 mgr.x (mgr.34778) 82 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cephadm 2024-01-21T07:50:50.014606+0000 mgr.x (mgr.34778) 83 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cephadm 2024-01-21T07:50:50.015732+0000 mgr.x (mgr.34778) 84 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cephadm 2024-01-21T07:50:50.020882+0000 mgr.x (mgr.34778) 85 : cephadm [INF] Failing over to other MGR 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cluster 2024-01-21T07:50:50.997140+0000 mon.a (mon.0) 701 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cluster 2024-01-21T07:50:50.998307+0000 mon.a (mon.0) 702 : cluster [INF] Activating manager daemon y 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: audit 2024-01-21T07:50:50.999520+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-21T07:50:52.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: audit 2024-01-21T07:50:51.008046+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:50:52.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cluster 2024-01-21T07:50:51.008244+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-01-21T07:50:52.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: audit 2024-01-21T07:50:51.008533+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:52.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: audit 2024-01-21T07:50:51.014680+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34778 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-01-21T07:50:52.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: cluster 2024-01-21T07:50:51.014784+0000 mon.a (mon.0) 706 : cluster [DBG] mgrmap e26: y(active, starting, since 0.0167908s) 2024-01-21T07:50:52.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: audit 2024-01-21T07:50:51.015805+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-21T07:50:52.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:51 smithi080 bash[17460]: audit 2024-01-21T07:50:51.016146+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:53.030 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:52 smithi195 bash[24590]: debug 2024-01-21T07:50:52.684+0000 7f4739cf4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:50:53.030 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:52 smithi195 bash[24590]: debug 2024-01-21T07:50:52.772+0000 7f4739cf4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:50:53.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:52 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:50:52] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:50:53.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:53 smithi195 bash[24590]: debug 2024-01-21T07:50:53.024+0000 7f4739cf4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:50:54.400 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:54 smithi195 bash[24590]: debug 2024-01-21T07:50:54.136+0000 7f4739cf4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:50:54.400 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:54 smithi195 bash[24590]: debug 2024-01-21T07:50:54.296+0000 7f4739cf4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:50:54.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:50:54 smithi080 bash[36089]: level=error ts=2024-01-21T07:50:54.241Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:50:54.731 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:54 smithi195 bash[24590]: debug 2024-01-21T07:50:54.392+0000 7f4739cf4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:50:54.731 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:54 smithi195 bash[24590]: debug 2024-01-21T07:50:54.500+0000 7f4739cf4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:50:55.096 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:54 smithi195 bash[24590]: debug 2024-01-21T07:50:54.724+0000 7f4739cf4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:50:55.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:55 smithi195 bash[24590]: debug 2024-01-21T07:50:55.088+0000 7f4739cf4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:50:55.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:55 smithi195 bash[24590]: debug 2024-01-21T07:50:55.208+0000 7f4739cf4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:50:56.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:56 smithi195 bash[24590]: debug 2024-01-21T07:50:56.064+0000 7f4739cf4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:50:56.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:56 smithi195 bash[24590]: debug 2024-01-21T07:50:56.164+0000 7f4739cf4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:50:56.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:56 smithi195 bash[24590]: debug 2024-01-21T07:50:56.280+0000 7f4739cf4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:50:56.797 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:56 smithi195 bash[24590]: debug 2024-01-21T07:50:56.496+0000 7f4739cf4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:50:57.078 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:56 smithi195 bash[24590]: debug 2024-01-21T07:50:56.788+0000 7f4739cf4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:50:57.078 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:56 smithi195 bash[24590]: debug 2024-01-21T07:50:56.952+0000 7f4739cf4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.019410+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.019860+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.020289+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.021872+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.022591+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.023389+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.023975+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.024641+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.025452+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:50:57.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.026079+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.026784+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.027149+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.027644+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.027978+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.028674+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.030038+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.031157+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.031673+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: [21/Jan/2024:07:50:57] ENGINE Bus STOPPING 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: [21/Jan/2024:07:50:57] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-21T07:50:57.298 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: [21/Jan/2024:07:50:57] ENGINE Bus STOPPED 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: [21/Jan/2024:07:50:57] ENGINE Bus STARTING 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.019410+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.019860+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.020289+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.021872+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.022591+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.023389+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.023975+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.024641+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.025452+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:50:57.299 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.026079+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.026784+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.027149+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.027644+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.027978+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.028674+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.030038+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.031157+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.031673+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:50:57.300 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.032261+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.032765+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.033270+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.033826+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.034320+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.034850+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_crt"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.035366+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_key"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.035978+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.036538+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.037048+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.037562+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.038088+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.038618+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.039137+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:50:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.039641+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.040155+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.040624+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.041115+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.041596+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.042088+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.042608+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.043128+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/prometheus/health_history"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.043614+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: audit 2024-01-21T07:50:57.044072+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[13909]: cluster 2024-01-21T07:50:57.063944+0000 mon.a (mon.0) 707 : cluster [INF] Manager daemon y is now available 2024-01-21T07:50:57.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.032261+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.032765+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.033270+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.033826+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.034320+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.034850+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_crt"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.035366+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_key"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.035978+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.036538+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.037048+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.037562+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.038088+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.038618+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.039137+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:50:57.303 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.039641+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.040155+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.040624+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.041115+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.041596+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.042088+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.042608+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.043128+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/prometheus/health_history"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.043614+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: audit 2024-01-21T07:50:57.044072+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:50:57.304 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[17460]: cluster 2024-01-21T07:50:57.063944+0000 mon.a (mon.0) 707 : cluster [INF] Manager daemon y is now available 2024-01-21T07:50:57.349 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: debug 2024-01-21T07:50:57.128+0000 7f4739cf4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.019410+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.019860+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.020289+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.021872+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.022591+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.023389+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.023975+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.024641+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.025452+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.026079+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:50:57.350 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.026784+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.027149+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.027644+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.027978+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.028674+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.030038+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.031157+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.031673+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.032261+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.032765+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.033270+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.033826+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.034320+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.034850+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_crt"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.035366+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_key"}]: dispatch 2024-01-21T07:50:57.351 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.035978+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.036538+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.037048+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.037562+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.038088+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.038618+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.039137+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.039641+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.040155+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.040624+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.041115+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:57.352 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.041596+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:57.353 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.042088+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:50:57.353 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.042608+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:50:57.353 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.043128+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/prometheus/health_history"}]: dispatch 2024-01-21T07:50:57.353 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.043614+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:50:57.353 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: audit 2024-01-21T07:50:57.044072+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:50:57.353 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[13978]: cluster 2024-01-21T07:50:57.063944+0000 mon.a (mon.0) 707 : cluster [INF] Manager daemon y is now available 2024-01-21T07:50:57.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: Warning: Permanently added '172.21.15.195' (ECDSA) to the list of known hosts. 2024-01-21T07:50:57.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: CherryPy Checker: 2024-01-21T07:50:57.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: The Application mounted at '' has an empty config. 2024-01-21T07:50:57.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: [21/Jan/2024:07:50:57] ENGINE Serving on http://:::9283 2024-01-21T07:50:57.559 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:50:57 smithi080 bash[36925]: [21/Jan/2024:07:50:57] ENGINE Bus STARTED 2024-01-21T07:50:57.599 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: debug 2024-01-21T07:50:57.344+0000 7f4739cf4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:50:57.599 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: debug 2024-01-21T07:50:57.456+0000 7f4739cf4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:50:57.599 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: [21/Jan/2024:07:50:57] ENGINE Bus STARTING 2024-01-21T07:50:57.600 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: CherryPy Checker: 2024-01-21T07:50:57.600 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: The Application mounted at '' has an empty config. 2024-01-21T07:50:57.600 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: [21/Jan/2024:07:50:57] ENGINE Serving on http://:::9283 2024-01-21T07:50:57.600 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:50:57 smithi195 bash[24590]: [21/Jan/2024:07:50:57] ENGINE Bus STARTED 2024-01-21T07:50:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: cephadm 2024-01-21T07:50:57.088380+0000 mgr.y (mgr.24922) 1 : cephadm [INF] inventory: adjusted host smithi195 addr 'smithi195' -> '172.21.15.195' 2024-01-21T07:50:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.088900+0000 mon.c (mon.1) 80 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:50:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.089259+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:50:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.093036+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:50:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: cluster 2024-01-21T07:50:57.124788+0000 mon.a (mon.0) 710 : cluster [DBG] mgrmap e27: y(active, since 6s) 2024-01-21T07:50:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: cluster 2024-01-21T07:50:57.131682+0000 mgr.y (mgr.24922) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.227488+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.231295+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.326807+0000 mon.c (mon.1) 83 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.327254+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.336776+0000 mon.c (mon.1) 84 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.337908+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: cluster 2024-01-21T07:50:57.484233+0000 mon.a (mon.0) 713 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.486785+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.488543+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.489346+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.493836+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.496745+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:58.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:58 smithi195 bash[13978]: audit 2024-01-21T07:50:57.622785+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: cephadm 2024-01-21T07:50:57.088380+0000 mgr.y (mgr.24922) 1 : cephadm [INF] inventory: adjusted host smithi195 addr 'smithi195' -> '172.21.15.195' 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.088900+0000 mon.c (mon.1) 80 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.089259+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.093036+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: cluster 2024-01-21T07:50:57.124788+0000 mon.a (mon.0) 710 : cluster [DBG] mgrmap e27: y(active, since 6s) 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: cluster 2024-01-21T07:50:57.131682+0000 mgr.y (mgr.24922) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.227488+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.231295+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.326807+0000 mon.c (mon.1) 83 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.327254+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.336776+0000 mon.c (mon.1) 84 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.337908+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: cluster 2024-01-21T07:50:57.484233+0000 mon.a (mon.0) 713 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.486785+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.488543+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.489346+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.493836+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.496745+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:58.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[13909]: audit 2024-01-21T07:50:57.622785+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: cephadm 2024-01-21T07:50:57.088380+0000 mgr.y (mgr.24922) 1 : cephadm [INF] inventory: adjusted host smithi195 addr 'smithi195' -> '172.21.15.195' 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.088900+0000 mon.c (mon.1) 80 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.089259+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.093036+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}, \"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"172.21.15.195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: cluster 2024-01-21T07:50:57.124788+0000 mon.a (mon.0) 710 : cluster [DBG] mgrmap e27: y(active, since 6s) 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: cluster 2024-01-21T07:50:57.131682+0000 mgr.y (mgr.24922) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.227488+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.231295+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.326807+0000 mon.c (mon.1) 83 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.327254+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.336776+0000 mon.c (mon.1) 84 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.337908+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:50:58.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: cluster 2024-01-21T07:50:57.484233+0000 mon.a (mon.0) 713 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:50:58.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.486785+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:58.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.488543+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:50:58.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.489346+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:50:58.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.493836+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:50:58.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.496745+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.195:0/2075493140' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:50:58.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:58 smithi080 bash[17460]: audit 2024-01-21T07:50:57.622785+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:50:59.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:59 smithi195 bash[13978]: cluster 2024-01-21T07:50:58.117957+0000 mon.a (mon.0) 714 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:50:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:59 smithi195 bash[13978]: cluster 2024-01-21T07:50:58.118035+0000 mon.a (mon.0) 715 : cluster [INF] Cluster is now healthy 2024-01-21T07:50:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:59 smithi195 bash[13978]: cluster 2024-01-21T07:50:58.141005+0000 mon.a (mon.0) 716 : cluster [DBG] mgrmap e28: y(active, since 7s), standbys: x 2024-01-21T07:50:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:50:59 smithi195 bash[13978]: audit 2024-01-21T07:50:58.144923+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:50:59.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[13909]: cluster 2024-01-21T07:50:58.117957+0000 mon.a (mon.0) 714 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:50:59.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[13909]: cluster 2024-01-21T07:50:58.118035+0000 mon.a (mon.0) 715 : cluster [INF] Cluster is now healthy 2024-01-21T07:50:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[13909]: cluster 2024-01-21T07:50:58.141005+0000 mon.a (mon.0) 716 : cluster [DBG] mgrmap e28: y(active, since 7s), standbys: x 2024-01-21T07:50:59.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[13909]: audit 2024-01-21T07:50:58.144923+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:50:59.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[17460]: cluster 2024-01-21T07:50:58.117957+0000 mon.a (mon.0) 714 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:50:59.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[17460]: cluster 2024-01-21T07:50:58.118035+0000 mon.a (mon.0) 715 : cluster [INF] Cluster is now healthy 2024-01-21T07:50:59.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[17460]: cluster 2024-01-21T07:50:58.141005+0000 mon.a (mon.0) 716 : cluster [DBG] mgrmap e28: y(active, since 7s), standbys: x 2024-01-21T07:50:59.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:50:59 smithi080 bash[17460]: audit 2024-01-21T07:50:58.144923+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:51:00.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:00 smithi195 bash[13978]: cluster 2024-01-21T07:50:59.025842+0000 mgr.y (mgr.24922) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:00.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:00 smithi195 bash[13978]: cluster 2024-01-21T07:50:59.917160+0000 mon.a (mon.0) 717 : cluster [DBG] mgrmap e29: y(active, since 8s), standbys: x 2024-01-21T07:51:00.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:00 smithi080 bash[13909]: cluster 2024-01-21T07:50:59.025842+0000 mgr.y (mgr.24922) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:00.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:00 smithi080 bash[13909]: cluster 2024-01-21T07:50:59.917160+0000 mon.a (mon.0) 717 : cluster [DBG] mgrmap e29: y(active, since 8s), standbys: x 2024-01-21T07:51:00.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:00 smithi080 bash[17460]: cluster 2024-01-21T07:50:59.025842+0000 mgr.y (mgr.24922) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:00.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:00 smithi080 bash[17460]: cluster 2024-01-21T07:50:59.917160+0000 mon.a (mon.0) 717 : cluster [DBG] mgrmap e29: y(active, since 8s), standbys: x 2024-01-21T07:51:02.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:02 smithi195 bash[13978]: cluster 2024-01-21T07:51:01.026649+0000 mgr.y (mgr.24922) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:02.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:02 smithi080 bash[13909]: cluster 2024-01-21T07:51:01.026649+0000 mgr.y (mgr.24922) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:02.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:02 smithi080 bash[17460]: cluster 2024-01-21T07:51:01.026649+0000 mgr.y (mgr.24922) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:03.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:02 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:02] "GET /metrics HTTP/1.1" 200 152314 "" "Prometheus/2.33.4" 2024-01-21T07:51:04.386 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: cluster 2024-01-21T07:51:03.028017+0000 mgr.y (mgr.24922) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.689283+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.690167+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.695737+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.870041+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.871251+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.877793+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.957853+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.958790+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.387 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.959530+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.960187+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.960900+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.961622+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.962449+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.963243+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:04 smithi195 bash[13978]: audit 2024-01-21T07:51:03.964030+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: cluster 2024-01-21T07:51:03.028017+0000 mgr.y (mgr.24922) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:04.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: cluster 2024-01-21T07:51:03.028017+0000 mgr.y (mgr.24922) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:04.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.689283+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.689283+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.690167+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.690167+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.695737+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:04.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.695737+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"container_id\": \"a6ee789e8ec5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106011033, \"cpu_percentage\": \"1.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.683784Z\", \"created\": \"2024-01-21T07:36:41.059624Z\", \"started\": \"2024-01-21T07:36:47.130390Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:52.713175Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.686707Z\", \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:04.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.870041+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.870041+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.871251+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.871251+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:04.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.877793+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:04.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.957853+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.958790+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.959530+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.960187+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.960900+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.961622+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.962449+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.963243+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[13909]: audit 2024-01-21T07:51:03.964030+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.877793+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"82dc6695abd6\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 397620019, \"cpu_percentage\": \"1.42%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864402Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:48:34.168926Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:48:20.888300Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:03.866771Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.957853+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.958790+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.959530+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.960187+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.960900+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.961622+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.962449+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:04.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.963243+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:04.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:04 smithi080 bash[17460]: audit 2024-01-21T07:51:03.964030+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.144278+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.145218+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.146085+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.146868+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.147852+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.148733+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.149549+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.150250+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.151022+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: cluster 2024-01-21T07:51:04.152933+0000 mgr.y (mgr.24922) 6 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:05.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.154073+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:05.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.155079+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:05.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.161536+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:51:05.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.172437+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:05.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.174259+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:05.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:05 smithi195 bash[13978]: audit 2024-01-21T07:51:04.174772+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:05.530 INFO:teuthology.orchestra.run.smithi080.stdout:true 2024-01-21T07:51:05.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.144278+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.145218+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.146085+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.146868+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.147852+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.148733+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.149549+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.150250+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.151022+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: cluster 2024-01-21T07:51:04.152933+0000 mgr.y (mgr.24922) 6 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.154073+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.155079+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.161536+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.172437+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.174259+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:05.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[17460]: audit 2024-01-21T07:51:04.174772+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.144278+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.145218+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.146085+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.146868+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.147852+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.148733+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.149549+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.150250+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.151022+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: cluster 2024-01-21T07:51:04.152933+0000 mgr.y (mgr.24922) 6 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.154073+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.155079+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.161536+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:51:05.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.172437+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:05.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.174259+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:05.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:05 smithi080 bash[13909]: audit 2024-01-21T07:51:04.174772+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:06.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:06 smithi195 bash[13978]: cluster 2024-01-21T07:51:05.100049+0000 mon.a (mon.0) 725 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:51:06.265 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:alertmanager.a smithi080 *:9093,9094 running (65s) 2s ago 112s 15.4M - 0.23.0 ba2b418f427c a9d41607da45 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (40s) 2s ago 7m 24.3M - 6.6.2 87a51ecf0b1c ccb48473f95f 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 running (2m) 2s ago 12m 379M - 16.2.14-454-gea310589 9b28eb2d7c37 82dc6695abd6 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 *:8443,9283 running (22s) 2s ago 14m 409M - 16.2.14-454-gea310589 9b28eb2d7c37 8c9e9c0849f8 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (14m) 2s ago 14m 101M 2048M 15.2.0 204a01f9b0b6 a6ee789e8ec5 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (12m) 2s ago 12m 107M 2048M 15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (12m) 2s ago 12m 102M 2048M 15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 2s ago 8m - - 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 2s ago 8m - - 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (11m) 2s ago 11m 51.3M 4096M 15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (11m) 2s ago 11m 51.8M 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (11m) 2s ago 11m 45.8M 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:51:06.266 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (10m) 2s ago 10m 48.2M 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (10m) 2s ago 10m 48.6M 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (9m) 2s ago 9m 48.0M 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (9m) 2s ago 9m 47.1M 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (8m) 2s ago 8m 49.6M 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:prometheus.a smithi195 *:9095 running (79s) 2s ago 79s 37.3M - 2.33.4 514e6a882f6e 9c7157bf1685 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (6m) 2s ago 6m 50.2M - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:51:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (6m) 2s ago 6m 49.6M - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:51:06.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:06 smithi080 bash[13909]: cluster 2024-01-21T07:51:05.100049+0000 mon.a (mon.0) 725 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:51:06.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:06 smithi080 bash[17460]: cluster 2024-01-21T07:51:05.100049+0000 mon.a (mon.0) 725 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:51:06.694 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:51:06.694 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 2 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-01-21T07:51:06.695 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 2 2024-01-21T07:51:06.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:51:06.696 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "in_progress": true, 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "which": "Upgrading all daemon types on all hosts", 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "services_complete": [ 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr" 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "progress": "2/20 daemons upgraded", 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "message": "Currently upgrading mgr daemons", 2024-01-21T07:51:07.056 INFO:teuthology.orchestra.run.smithi080.stdout: "is_paused": false 2024-01-21T07:51:07.057 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:51:07.131 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:06 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:51:07.132 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:05.513718+0000 mgr.y (mgr.24922) 7 : audit [DBG] from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.132 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:05.876507+0000 mgr.y (mgr.24922) 8 : audit [DBG] from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.132 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: cluster 2024-01-21T07:51:06.153689+0000 mgr.y (mgr.24922) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:07.132 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.238208+0000 mgr.y (mgr.24922) 10 : audit [DBG] from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.243750+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.244660+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.245422+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.246221+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.246908+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.247509+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.250013+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.250646+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.251205+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.251715+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.252215+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: cephadm 2024-01-21T07:51:06.427392+0000 mgr.y (mgr.24922) 11 : cephadm [INF] Upgrade: Updating mgr.x 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.428141+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.428651+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:51:07.133 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.430793+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:51:07.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.432762+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:07.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: cephadm 2024-01-21T07:51:06.434280+0000 mgr.y (mgr.24922) 12 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:51:07.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.435281+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-01-21T07:51:07.134 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:07 smithi195 bash[13978]: audit 2024-01-21T07:51:06.692716+0000 mon.a (mon.0) 727 : audit [DBG] from='client.? 172.21.15.80:0/427478834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:07.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:05.513718+0000 mgr.y (mgr.24922) 7 : audit [DBG] from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:05.876507+0000 mgr.y (mgr.24922) 8 : audit [DBG] from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: cluster 2024-01-21T07:51:06.153689+0000 mgr.y (mgr.24922) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:07.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.238208+0000 mgr.y (mgr.24922) 10 : audit [DBG] from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.243750+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.244660+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.245422+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.246221+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.246908+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.247509+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.250013+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.250646+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.251205+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.251715+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.252215+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: cephadm 2024-01-21T07:51:06.427392+0000 mgr.y (mgr.24922) 11 : cephadm [INF] Upgrade: Updating mgr.x 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.428141+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.428651+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.430793+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.432762+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:07.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: cephadm 2024-01-21T07:51:06.434280+0000 mgr.y (mgr.24922) 12 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:51:07.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.435281+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-01-21T07:51:07.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[13909]: audit 2024-01-21T07:51:06.692716+0000 mon.a (mon.0) 727 : audit [DBG] from='client.? 172.21.15.80:0/427478834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:07.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:05.513718+0000 mgr.y (mgr.24922) 7 : audit [DBG] from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:05.876507+0000 mgr.y (mgr.24922) 8 : audit [DBG] from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: cluster 2024-01-21T07:51:06.153689+0000 mgr.y (mgr.24922) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.238208+0000 mgr.y (mgr.24922) 10 : audit [DBG] from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.243750+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.244660+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.245422+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.246221+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.246908+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.563 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.247509+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.250013+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.250646+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.251205+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.251715+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.252215+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: cephadm 2024-01-21T07:51:06.427392+0000 mgr.y (mgr.24922) 11 : cephadm [INF] Upgrade: Updating mgr.x 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.428141+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.428651+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.430793+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:51:07.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.432762+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:07.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: cephadm 2024-01-21T07:51:06.434280+0000 mgr.y (mgr.24922) 12 : cephadm [INF] Deploying daemon mgr.x on smithi195 2024-01-21T07:51:07.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.435281+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-01-21T07:51:07.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:07 smithi080 bash[17460]: audit 2024-01-21T07:51:06.692716+0000 mon.a (mon.0) 727 : audit [DBG] from='client.? 172.21.15.80:0/427478834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:08.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:08 smithi195 bash[13978]: audit 2024-01-21T07:51:07.053523+0000 mgr.y (mgr.24922) 13 : audit [DBG] from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:08.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:08 smithi080 bash[13909]: audit 2024-01-21T07:51:07.053523+0000 mgr.y (mgr.24922) 13 : audit [DBG] from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:08.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:08 smithi080 bash[17460]: audit 2024-01-21T07:51:07.053523+0000 mgr.y (mgr.24922) 13 : audit [DBG] from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:08.888 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:08 smithi195 systemd[1]: Stopping Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:51:09.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:09 smithi080 bash[13909]: cluster 2024-01-21T07:51:08.155275+0000 mgr.y (mgr.24922) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:09.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:09 smithi080 bash[17460]: cluster 2024-01-21T07:51:08.155275+0000 mgr.y (mgr.24922) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:09.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:09 smithi195 bash[13978]: cluster 2024-01-21T07:51:08.155275+0000 mgr.y (mgr.24922) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:11.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:11 smithi080 bash[13909]: cluster 2024-01-21T07:51:10.156066+0000 mgr.y (mgr.24922) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:11.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:11 smithi080 bash[17460]: cluster 2024-01-21T07:51:10.156066+0000 mgr.y (mgr.24922) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:11.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:11 smithi195 bash[13978]: cluster 2024-01-21T07:51:10.156066+0000 mgr.y (mgr.24922) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:13.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:12 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:12] "GET /metrics HTTP/1.1" 200 152536 "" "Prometheus/2.33.4" 2024-01-21T07:51:13.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:13 smithi080 bash[13909]: cluster 2024-01-21T07:51:12.157513+0000 mgr.y (mgr.24922) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:13.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:13 smithi080 bash[17460]: cluster 2024-01-21T07:51:12.157513+0000 mgr.y (mgr.24922) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:13.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:13 smithi195 bash[13978]: cluster 2024-01-21T07:51:12.157513+0000 mgr.y (mgr.24922) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:15.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:14 smithi080 bash[13909]: cluster 2024-01-21T07:51:14.158276+0000 mgr.y (mgr.24922) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:15.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:14 smithi080 bash[17460]: cluster 2024-01-21T07:51:14.158276+0000 mgr.y (mgr.24922) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:15.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:14 smithi195 bash[13978]: cluster 2024-01-21T07:51:14.158276+0000 mgr.y (mgr.24922) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:17.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:16 smithi195 bash[24590]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:51:17.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:17 smithi080 bash[13909]: cluster 2024-01-21T07:51:16.159101+0000 mgr.y (mgr.24922) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:17.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:17 smithi080 bash[17460]: cluster 2024-01-21T07:51:16.159101+0000 mgr.y (mgr.24922) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:17.638 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:17 smithi195 bash[13978]: cluster 2024-01-21T07:51:16.159101+0000 mgr.y (mgr.24922) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:19.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:19 smithi080 bash[13909]: cluster 2024-01-21T07:51:18.160617+0000 mgr.y (mgr.24922) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:19.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:19 smithi080 bash[17460]: cluster 2024-01-21T07:51:18.160617+0000 mgr.y (mgr.24922) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:19.633 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:19 smithi195 bash[13978]: cluster 2024-01-21T07:51:18.160617+0000 mgr.y (mgr.24922) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:19.885 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:19 smithi195 bash[29045]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.x 2024-01-21T07:51:19.886 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:19 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-01-21T07:51:19.886 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:19 smithi195 bash[29108]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.x 2024-01-21T07:51:20.204 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:19 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-01-21T07:51:20.204 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:19 smithi195 systemd[1]: Stopped Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:51:20.204 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:20 smithi195 systemd[1]: Started Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:51:21.425 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[29223]: debug 2024-01-21T07:51:21.260+0000 7f4bae94b700 1 -- 172.21.15.195:0/1352403940 <== mon.2 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5599c5fda4e0 con 0x5599c60cec00 2024-01-21T07:51:21.426 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[13978]: cluster 2024-01-21T07:51:20.161353+0000 mgr.y (mgr.24922) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:21.426 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[13978]: audit 2024-01-21T07:51:20.244520+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:21.427 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[13978]: audit 2024-01-21T07:51:20.245823+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:21.427 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[13978]: audit 2024-01-21T07:51:20.252905+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:21.427 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[13978]: audit 2024-01-21T07:51:20.256840+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:21.427 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[13978]: audit 2024-01-21T07:51:20.260093+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:21.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[13909]: cluster 2024-01-21T07:51:20.161353+0000 mgr.y (mgr.24922) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:21.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[17460]: cluster 2024-01-21T07:51:20.161353+0000 mgr.y (mgr.24922) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:21.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[17460]: audit 2024-01-21T07:51:20.244520+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:21.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[13909]: audit 2024-01-21T07:51:20.244520+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[13909]: audit 2024-01-21T07:51:20.245823+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[13909]: audit 2024-01-21T07:51:20.252905+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[13909]: audit 2024-01-21T07:51:20.256840+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[13909]: audit 2024-01-21T07:51:20.260093+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[17460]: audit 2024-01-21T07:51:20.245823+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[17460]: audit 2024-01-21T07:51:20.252905+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112512204, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864040Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443, 9283]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51023708, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864658Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.864939Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865207Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52072284, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865487Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.865731Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25564282, \"cpu_percentage\": \"1.59%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-01-21T07:51:03.865879Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.866119Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 39164313, \"cpu_percentage\": \"0.23%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:03.866361Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:21.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[17460]: audit 2024-01-21T07:51:20.256840+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:21.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:21 smithi080 bash[17460]: audit 2024-01-21T07:51:20.260093+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:21.888 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[29223]: debug 2024-01-21T07:51:21.416+0000 7f4bbef46680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:51:21.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[29223]: debug 2024-01-21T07:51:21.520+0000 7f4bbef46680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:51:22.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:21 smithi195 bash[29223]: debug 2024-01-21T07:51:21.964+0000 7f4bbef46680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:51:23.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:22 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:22] "GET /metrics HTTP/1.1" 200 152536 "" "Prometheus/2.33.4" 2024-01-21T07:51:23.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:22 smithi195 bash[29223]: debug 2024-01-21T07:51:22.876+0000 7f4bbef46680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:51:23.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:22 smithi195 bash[29223]: debug 2024-01-21T07:51:22.968+0000 7f4bbef46680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:51:23.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:23 smithi080 bash[13909]: cluster 2024-01-21T07:51:22.162825+0000 mgr.y (mgr.24922) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:23.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:23 smithi080 bash[17460]: cluster 2024-01-21T07:51:22.162825+0000 mgr.y (mgr.24922) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:23.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:23 smithi195 bash[13978]: cluster 2024-01-21T07:51:22.162825+0000 mgr.y (mgr.24922) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:23.640 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:23 smithi195 bash[29223]: debug 2024-01-21T07:51:23.216+0000 7f4bbef46680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:51:24.611 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:24 smithi195 bash[29223]: debug 2024-01-21T07:51:24.344+0000 7f4bbef46680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:51:24.612 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:24 smithi195 bash[29223]: debug 2024-01-21T07:51:24.508+0000 7f4bbef46680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:51:24.890 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:24 smithi195 bash[29223]: debug 2024-01-21T07:51:24.604+0000 7f4bbef46680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:51:24.890 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:24 smithi195 bash[29223]: debug 2024-01-21T07:51:24.712+0000 7f4bbef46680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:51:25.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:24 smithi080 bash[13909]: cluster 2024-01-21T07:51:24.163578+0000 mgr.y (mgr.24922) 22 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:25.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:24 smithi080 bash[17460]: cluster 2024-01-21T07:51:24.163578+0000 mgr.y (mgr.24922) 22 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:25.320 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:24 smithi195 bash[13978]: cluster 2024-01-21T07:51:24.163578+0000 mgr.y (mgr.24922) 22 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:25.321 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:24 smithi195 bash[29223]: debug 2024-01-21T07:51:24.932+0000 7f4bbef46680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:51:25.321 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:25 smithi195 bash[29223]: debug 2024-01-21T07:51:25.312+0000 7f4bbef46680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:51:25.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:25 smithi195 bash[29223]: debug 2024-01-21T07:51:25.436+0000 7f4bbef46680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:51:26.887 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:26 smithi195 bash[29223]: debug 2024-01-21T07:51:26.400+0000 7f4bbef46680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:51:26.887 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:26 smithi195 bash[29223]: debug 2024-01-21T07:51:26.512+0000 7f4bbef46680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:51:26.887 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:26 smithi195 bash[29223]: debug 2024-01-21T07:51:26.640+0000 7f4bbef46680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:51:27.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:26 smithi195 bash[29223]: debug 2024-01-21T07:51:26.880+0000 7f4bbef46680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:51:27.477 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: cluster 2024-01-21T07:51:26.164647+0000 mgr.y (mgr.24922) 23 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.477 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: cluster 2024-01-21T07:51:26.164647+0000 mgr.y (mgr.24922) 23 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.478 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.317955+0000 mon.c (mon.1) 133 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:27.478 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.317955+0000 mon.c (mon.1) 133 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.319198+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.325763+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: cluster 2024-01-21T07:51:26.328388+0000 mgr.y (mgr.24922) 24 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: cluster 2024-01-21T07:51:26.328966+0000 mgr.y (mgr.24922) 25 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.329808+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.332499+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.338245+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.347853+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.349143+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:27.479 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.349593+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.351799+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: cephadm 2024-01-21T07:51:26.352758+0000 mgr.y (mgr.24922) 26 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.353061+0000 mon.c (mon.1) 138 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.353635+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.359886+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]': finished 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.362417+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.362858+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.370005+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.371701+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.372143+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.380009+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-01-21T07:51:27.480 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.382479+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:51:27.481 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: audit 2024-01-21T07:51:26.383947+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-21T07:51:27.481 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[17460]: cephadm 2024-01-21T07:51:26.385203+0000 mgr.y (mgr.24922) 27 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-01-21T07:51:27.481 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.319198+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:27.481 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.325763+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:27.481 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: cluster 2024-01-21T07:51:26.328388+0000 mgr.y (mgr.24922) 24 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.481 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: cluster 2024-01-21T07:51:26.328966+0000 mgr.y (mgr.24922) 25 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.329808+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.332499+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.338245+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.347853+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.349143+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.349593+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.351799+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: cephadm 2024-01-21T07:51:26.352758+0000 mgr.y (mgr.24922) 26 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.353061+0000 mon.c (mon.1) 138 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.353635+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.359886+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]': finished 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.362417+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.362858+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-21T07:51:27.482 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.370005+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-01-21T07:51:27.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.371701+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-21T07:51:27.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.372143+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-21T07:51:27.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.380009+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-01-21T07:51:27.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.382479+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:51:27.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: audit 2024-01-21T07:51:26.383947+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-21T07:51:27.483 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:27 smithi080 bash[13909]: cephadm 2024-01-21T07:51:26.385203+0000 mgr.y (mgr.24922) 27 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-01-21T07:51:27.527 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: debug 2024-01-21T07:51:27.184+0000 7f4bbef46680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:51:27.527 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: debug 2024-01-21T07:51:27.348+0000 7f4bbef46680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:51:27.527 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: cluster 2024-01-21T07:51:26.164647+0000 mgr.y (mgr.24922) 23 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.528 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.317955+0000 mon.c (mon.1) 133 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.319198+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.325763+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi195\", \"container_id\": \"ee6227a186a5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 112617062, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312163Z\", \"created\": \"2024-01-21T07:38:35.160135Z\", \"started\": \"2024-01-21T07:38:35.184331Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi195\", \"container_id\": \"2a953d798d62\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 89087016, \"cpu_percentage\": \"99.95%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:26.312549Z\", \"created\": \"2024-01-21T07:38:51.927748Z\", \"started\": \"2024-01-21T07:51:20.254637Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi195\", \"container_id\": \"5587796ebacc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51233423, \"cpu_percentage\": \"2.23%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.312817Z\", \"created\": \"2024-01-21T07:40:49.926393Z\", \"started\": \"2024-01-21T07:40:53.317171Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi195\", \"container_id\": \"b386458d6202\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50709135, \"cpu_percentage\": \"2.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313071Z\", \"created\": \"2024-01-21T07:41:15.313825Z\", \"started\": \"2024-01-21T07:41:19.117300Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi195\", \"container_id\": \"db8e03aabfc7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49587159, \"cpu_percentage\": \"1.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313339Z\", \"created\": \"2024-01-21T07:41:40.993249Z\", \"started\": \"2024-01-21T07:41:45.403526Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi195\", \"container_id\": \"048583616e4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52261027, \"cpu_percentage\": \"2.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313587Z\", \"created\": \"2024-01-21T07:42:07.484653Z\", \"started\": \"2024-01-21T07:42:11.022412Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi195\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313836Z\", \"created\": \"2024-01-21T07:42:32.704085Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi195\", \"container_id\": \"ccb48473f95f\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 25836912, \"cpu_percentage\": \"0.07%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.313986Z\", \"created\": \"2024-01-21T07:43:14.171149Z\", \"started\": \"2024-01-21T07:50:25.688498Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi195.uawmcm\", \"daemon_name\": \"rgw.r.z.smithi195.uawmcm\", \"hostname\": \"smithi195\", \"container_id\": \"f3f8703227f6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52292485, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:26.314231Z\", \"created\": \"2024-01-21T07:44:43.829184Z\", \"started\": \"2024-01-21T07:44:43.848752Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi195\", \"container_id\": \"9c7157bf1685\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\"], \"memory_usage\": 45896171, \"cpu_percentage\": \"1.14%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [9095], \"last_refresh\": \"2024-01-21T07:51:26.314477Z\", \"created\": \"2024-01-21T07:49:46.378472Z\", \"started\": \"2024-01-21T07:49:46.436576Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099235Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"77f80413-d084-4cd8-a2d3-37352ceb17a5\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"QS2lUN-xWC2-6CeB-Tri6-NQOG-Efwh-6tDOFs\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3e78aad1-ff7d-47d1-aabf-a437f0a10df6\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"91gz8l-XAbE-Yha6-4gsR-NzRZ-5WaC-gA23cM\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"20fb8ae4-0923-4d21-936c-8c8ebbc279f8\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"ufHuHw-7CRk-ZL8u-VoNB-rzcC-8BdZ-Ewhv6z\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a2c86a3c-7c72-4f55-bf73-9ec14d925b25\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"wtfxFm-E0hH-Sz0k-7TjJ-bely-QL6f-bdS6qo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300FS480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.099253Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5XLZZ\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:01.115603Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:06.434033Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:47.738516Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:13.147995Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-01-21T07:41:38.678350Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:05.319892Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:32.025930Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-01-21T07:50:03.500683Z\"}, \"rgw.r.z.smithi195.uawmcm\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:41.317511Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-01-21T07:49:34.849756Z\"}}, \"last_daemon_update\": \"2024-01-21T07:51:26.314907Z\", \"last_device_update\": \"2024-01-21T07:42:14.728522Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.754419Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: cluster 2024-01-21T07:51:26.328388+0000 mgr.y (mgr.24922) 24 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: cluster 2024-01-21T07:51:26.328966+0000 mgr.y (mgr.24922) 25 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.329808+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.332499+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.338245+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.347853+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.349143+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.349593+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-01-21T07:51:27.529 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.351799+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: cephadm 2024-01-21T07:51:26.352758+0000 mgr.y (mgr.24922) 26 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.353061+0000 mon.c (mon.1) 138 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.353635+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.359886+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mgr"}]': finished 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.362417+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.362858+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.370005+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.371701+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.372143+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.380009+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.382479+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: audit 2024-01-21T07:51:26.383947+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-21T07:51:27.530 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[13978]: cephadm 2024-01-21T07:51:26.385203+0000 mgr.y (mgr.24922) 27 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-01-21T07:51:27.851 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: debug 2024-01-21T07:51:27.520+0000 7f4bbef46680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:51:27.851 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: debug 2024-01-21T07:51:27.736+0000 7f4bbef46680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:51:28.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: debug 2024-01-21T07:51:27.844+0000 7f4bbef46680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:51:28.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: [21/Jan/2024:07:51:27] ENGINE Bus STARTING 2024-01-21T07:51:28.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: CherryPy Checker: 2024-01-21T07:51:28.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: The Application mounted at '' has an empty config. 2024-01-21T07:51:28.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: [21/Jan/2024:07:51:27] ENGINE Serving on http://:::9283 2024-01-21T07:51:28.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:27 smithi195 bash[29223]: [21/Jan/2024:07:51:27] ENGINE Bus STARTED 2024-01-21T07:51:28.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:28 smithi195 bash[13978]: cluster 2024-01-21T07:51:27.872522+0000 mon.a (mon.0) 741 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:51:28.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:28 smithi195 bash[13978]: cluster 2024-01-21T07:51:27.872741+0000 mon.a (mon.0) 742 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:51:28.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:28 smithi195 bash[13978]: audit 2024-01-21T07:51:27.874519+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:51:28.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:28 smithi195 bash[13978]: audit 2024-01-21T07:51:27.875926+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:28.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:28 smithi195 bash[13978]: audit 2024-01-21T07:51:27.880867+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:51:28.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:28 smithi195 bash[13978]: audit 2024-01-21T07:51:27.883841+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:28.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[13909]: cluster 2024-01-21T07:51:27.872522+0000 mon.a (mon.0) 741 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[13909]: cluster 2024-01-21T07:51:27.872741+0000 mon.a (mon.0) 742 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[13909]: audit 2024-01-21T07:51:27.874519+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[13909]: audit 2024-01-21T07:51:27.875926+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[13909]: audit 2024-01-21T07:51:27.880867+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[13909]: audit 2024-01-21T07:51:27.883841+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[17460]: cluster 2024-01-21T07:51:27.872522+0000 mon.a (mon.0) 741 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[17460]: cluster 2024-01-21T07:51:27.872741+0000 mon.a (mon.0) 742 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:51:28.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[17460]: audit 2024-01-21T07:51:27.874519+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:51:28.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[17460]: audit 2024-01-21T07:51:27.875926+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:28.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[17460]: audit 2024-01-21T07:51:27.880867+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:51:28.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:28 smithi080 bash[17460]: audit 2024-01-21T07:51:27.883841+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.? 172.21.15.195:0/45278592' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:29.639 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: cephadm 2024-01-21T07:51:28.325390+0000 mgr.y (mgr.24922) 28 : cephadm [INF] Upgrade: Updating mon.a 2024-01-21T07:51:29.639 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.326096+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:29.639 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: cluster 2024-01-21T07:51:28.330917+0000 mgr.y (mgr.24922) 29 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:29.639 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.335563+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: cluster 2024-01-21T07:51:28.342949+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e30: y(active, since 37s), standbys: x 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.352531+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]': finished 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.354070+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.355008+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.355943+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: cephadm 2024-01-21T07:51:28.356842+0000 mgr.y (mgr.24922) 30 : cephadm [INF] Deploying daemon mon.a on smithi080 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[13909]: audit 2024-01-21T07:51:28.357394+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: cephadm 2024-01-21T07:51:28.325390+0000 mgr.y (mgr.24922) 28 : cephadm [INF] Upgrade: Updating mon.a 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.326096+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: cluster 2024-01-21T07:51:28.330917+0000 mgr.y (mgr.24922) 29 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.335563+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:29.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: cluster 2024-01-21T07:51:28.342949+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e30: y(active, since 37s), standbys: x 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.352531+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]': finished 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.354070+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.355008+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.355943+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: cephadm 2024-01-21T07:51:28.356842+0000 mgr.y (mgr.24922) 30 : cephadm [INF] Deploying daemon mon.a on smithi080 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:29 smithi195 bash[13978]: audit 2024-01-21T07:51:28.357394+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: cephadm 2024-01-21T07:51:28.325390+0000 mgr.y (mgr.24922) 28 : cephadm [INF] Upgrade: Updating mon.a 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.326096+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: cluster 2024-01-21T07:51:28.330917+0000 mgr.y (mgr.24922) 29 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.335563+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: cluster 2024-01-21T07:51:28.342949+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e30: y(active, since 37s), standbys: x 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.352531+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]': finished 2024-01-21T07:51:29.641 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.354070+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:29.642 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.355008+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:29.642 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.355943+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:29.642 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: cephadm 2024-01-21T07:51:28.356842+0000 mgr.y (mgr.24922) 30 : cephadm [INF] Deploying daemon mon.a on smithi080 2024-01-21T07:51:29.642 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:29 smithi080 bash[17460]: audit 2024-01-21T07:51:28.357394+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:51:30.479 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:30 smithi080 systemd[1]: Stopping Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:51:30.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:30 smithi080 bash[13909]: debug 2024-01-21T07:51:30.472+0000 7f74d1e9c700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:51:30.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:30 smithi080 bash[13909]: debug 2024-01-21T07:51:30.472+0000 7f74d1e9c700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-01-21T07:51:31.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:31 smithi080 bash[38464]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.a 2024-01-21T07:51:31.303 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:31 smithi080 bash[38522]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.a 2024-01-21T07:51:31.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:31 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service: Succeeded. 2024-01-21T07:51:31.554 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:31 smithi080 systemd[1]: Stopped Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:51:31.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:31 smithi080 systemd[1]: Started Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:51:32.660 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.504+0000 7eff1f075880 0 set uid:gid to 167:167 (ceph:ceph) 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.504+0000 7eff1f075880 0 ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable), process ceph-mon, pid 7 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.504+0000 7eff1f075880 0 pidfile_write: ignore empty --pid-file 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 0 load: jerasure load: lrc load: isa 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: RocksDB version: 6.8.1 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Compile date Jan 19 2024 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: DB SUMMARY 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: CURRENT file: CURRENT 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: IDENTITY file: IDENTITY 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 1012 Bytes 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000029.sst 000030.sst 2024-01-21T07:51:32.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000027.log size: 14493144 ; 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.create_if_missing: 0 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.env: 0x5633dedec080 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.fs: Posix File System 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.info_log: 0x5633e161a220 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:51:32.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:51:32.663 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:51:32.663 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.db_log_dir: 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-21T07:51:32.664 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.write_buffer_manager: 0x5633e230e390 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:51:32.665 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.unordered_write: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.row_cache: None 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.wal_filter: None 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:51:32.666 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.log_readahead_size: 0 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:51:32.667 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Compression algorithms supported: 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kZSTD supported: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:51:32.668 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.merge_operator: 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5633e15bdd28) 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: cache_index_and_filter_blocks: 1 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:51:32.669 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: pin_top_level_index_and_filter: 1 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: index_type: 0 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: data_block_index_type: 0 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: index_shortening: 1 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: hash_index_allow_collision: 1 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: checksum: 1 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: no_block_cache: 0 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_cache: 0x5633e15f4f10 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_cache_name: BinnedLRUCache 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_cache_options: 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: capacity : 536870912 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: num_shard_bits : 4 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: strict_capacity_limit : 0 2024-01-21T07:51:32.670 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: high_pri_pool_ratio: 0.000 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_cache_compressed: (nil) 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: persistent_cache: (nil) 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_size: 4096 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_size_deviation: 10 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_restart_interval: 16 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: index_block_restart_interval: 1 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: metadata_block_size: 4096 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: partition_filters: 0 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: use_delta_encoding: 1 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: whole_key_filtering: 1 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: verify_compression: 0 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: read_amp_bytes_per_bit: 0 2024-01-21T07:51:32.671 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: format_version: 2 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: enable_index_compression: 1 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: block_align: 0 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.num_levels: 7 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-21T07:51:32.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:51:32.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:51:32.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:51:32.675 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:51:32.675 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:51:32.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.ttl: 2592000 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-01-21T07:51:32.677 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 32, last_sequence is 10942, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 27 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823492517428, "job": 1, "event": "recovery_started", "log_files": [27]} 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.512+0000 7eff1f075880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #27 mode 2 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.532+0000 7eff1f075880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.560+0000 7eff1f075880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823492565751, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 14411661, "table_properties": {"data_size": 14402573, "index_size": 7304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 965, "raw_key_size": 7659, "raw_average_key_size": 22, "raw_value_size": 14391983, "raw_average_value_size": 41475, "num_data_blocks": 227, "num_entries": 347, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1705823492, "oldest_key_time": 3, "file_creation_time": 0}} 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.560+0000 7eff1f075880 4 rocksdb: [version_set.cc:3826] Creating manifest 33 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.564+0000 7eff1f075880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823492566737, "job": 1, "event": "recovery_finished"} 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.564+0000 7eff1f075880 4 rocksdb: DB pointer 0x5633e16bd800 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.568+0000 7eff05e67700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.568+0000 7eff05e67700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** DB Stats ** 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Uptime(secs): 0.1 total, 0.1 interval 2024-01-21T07:51:32.678 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** Compaction Stats [default] ** 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: L0 1/0 13.74 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: L6 2/0 90.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Sum 3/0 104.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.679 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** Compaction Stats [default] ** 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Uptime(secs): 0.1 total, 0.1 interval 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Flush(GB): cumulative 0.013, interval 0.013 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Cumulative compaction: 0.01 GB write, 252.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Interval compaction: 0.01 GB write, 252.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:51:32.680 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** Compaction Stats [default] ** 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: L0 1/0 13.74 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: L6 2/0 90.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Sum 3/0 104.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** Compaction Stats [default] ** 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 493.1 0.03 0.00 1 0.028 0 0 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Uptime(secs): 0.1 total, 0.0 interval 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Flush(GB): cumulative 0.013, interval 0.000 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:51:32.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Cumulative compaction: 0.01 GB write, 251.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.568+0000 7eff1f075880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.568+0000 7eff1f075880 1 mon.a@-1(???) e3 preinit fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 0 mon.a@-1(???).mds e1 new map 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 0 mon.a@-1(???).mds e1 print_map 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: e1 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: enable_multiple, ever_enabled_multiple: 0,0 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: legacy client fscid: -1 2024-01-21T07:51:32.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: No filesystems configured 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 0 mon.a@-1(???).osd e64 crush map has features 3314933000852226048, adjusting msgr requires 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 0 mon.a@-1(???).osd e64 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 0 mon.a@-1(???).osd e64 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 0 mon.a@-1(???).osd e64 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: cephadm 2024-01-21T07:51:28.325390+0000 mgr.y (mgr.24922) 28 : cephadm [INF] Upgrade: Updating mon.a 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.326096+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: cluster 2024-01-21T07:51:28.330917+0000 mgr.y (mgr.24922) 29 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.335563+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]: dispatch 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: cluster 2024-01-21T07:51:28.342949+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e30: y(active, since 37s), standbys: x 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.352531+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24922 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24", "who": "mon.a"}]': finished 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.354070+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.355008+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:32.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.355943+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:32.684 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: cephadm 2024-01-21T07:51:28.356842+0000 mgr.y (mgr.24922) 30 : cephadm [INF] Deploying daemon mon.a on smithi080 2024-01-21T07:51:32.684 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: audit 2024-01-21T07:51:28.357394+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:51:32.684 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[38631]: debug 2024-01-21T07:51:32.572+0000 7eff1f075880 1 mon.a@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-01-21T07:51:33.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:32 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:32] "GET /metrics HTTP/1.1" 200 152529 "" "Prometheus/2.33.4" 2024-01-21T07:51:34.339 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[36925]: ignoring --setuser ceph since I am not root 2024-01-21T07:51:34.339 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[36925]: ignoring --setgroup ceph since I am not root 2024-01-21T07:51:34.339 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[36925]: debug 2024-01-21T07:51:34.076+0000 7faafd999700 1 -- 172.21.15.80:0/1364014607 <== mon.1 v2:172.21.15.80:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dedf6f44e0 con 0x55dedf7e8800 2024-01-21T07:51:34.339 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[36925]: debug 2024-01-21T07:51:34.228+0000 7fab0db76680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:51:34.339 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[36925]: debug 2024-01-21T07:51:34.332+0000 7fab0db76680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:51:34.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: audit 2024-01-21T07:51:31.584173+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:28.356709Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:34.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:32.333048+0000 mgr.y (mgr.24922) 32 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:34.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:33.994041+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-01-21T07:51:34.341 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:33.999148+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.007566+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.008276+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.008347+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.009980+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e30: y(active, since 43s), standbys: x 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.029236+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e31: y(active, since 43s), standbys: x 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.031432+0000 mon.a (mon.0) 8 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.031484+0000 mon.a (mon.0) 9 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.031513+0000 mon.a (mon.0) 10 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: cluster 2024-01-21T07:51:34.031541+0000 mon.a (mon.0) 11 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:51:34.342 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[38631]: audit 2024-01-21T07:51:34.042603+0000 mon.a (mon.0) 12 : audit [INF] from='mgr.24922 ' entity='' 2024-01-21T07:51:34.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: audit 2024-01-21T07:51:31.584173+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:28.356709Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:34.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:32.333048+0000 mgr.y (mgr.24922) 32 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:34.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:33.994041+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-01-21T07:51:34.343 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:33.999148+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.007566+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.008276+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.008347+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.009980+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e30: y(active, since 43s), standbys: x 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.029236+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e31: y(active, since 43s), standbys: x 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.031432+0000 mon.a (mon.0) 8 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:51:34.344 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.031484+0000 mon.a (mon.0) 9 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:51:34.345 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.031513+0000 mon.a (mon.0) 10 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:51:34.345 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: cluster 2024-01-21T07:51:34.031541+0000 mon.a (mon.0) 11 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:51:34.345 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[17460]: audit 2024-01-21T07:51:34.042603+0000 mon.a (mon.0) 12 : audit [INF] from='mgr.24922 ' entity='' 2024-01-21T07:51:34.347 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[29223]: ignoring --setuser ceph since I am not root 2024-01-21T07:51:34.347 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[29223]: ignoring --setgroup ceph since I am not root 2024-01-21T07:51:34.347 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[29223]: debug 2024-01-21T07:51:34.076+0000 7f1f7ecd7700 1 -- 172.21.15.195:0/2001510877 <== mon.2 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555c503884e0 con 0x555c5047cc00 2024-01-21T07:51:34.347 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[29223]: debug 2024-01-21T07:51:34.236+0000 7f1f8eeb4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T07:51:34.348 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: audit 2024-01-21T07:51:31.584173+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.24922 172.21.15.80:0/869727635' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi080\", \"container_id\": \"8c9e9c0849f8\", \"container_image_id\": \"9b28eb2d7c37a19008711b1b678be1a430e065f20ee023b4f4e779129fc1ff61\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:1b24450ab6fb489afb5fe4805ef16395673dc2aab2108084613a229213867b24\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"3.56%\", \"version\": \"16.2.14-454-gea310589\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443, 9283], \"last_refresh\": \"2024-01-21T07:51:03.684272Z\", \"created\": \"2024-01-21T07:36:49.387432Z\", \"started\": \"2024-01-21T07:50:43.507500Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi080\", \"container_id\": \"ead96e485721\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107793612, \"cpu_percentage\": \"1.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684547Z\", \"created\": \"2024-01-21T07:38:19.897347Z\", \"started\": \"2024-01-21T07:38:19.917798Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi080\", \"container_id\": \"960abfd97f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 53854863, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.684813Z\", \"created\": \"2024-01-21T07:39:10.808174Z\", \"started\": \"2024-01-21T07:39:14.034422Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi080\", \"container_id\": \"b7790bbaecb5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 54400122, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685060Z\", \"created\": \"2024-01-21T07:39:35.335977Z\", \"started\": \"2024-01-21T07:39:38.855648Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi080\", \"container_id\": \"35b06ffa44ef\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48119152, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685305Z\", \"created\": \"2024-01-21T07:40:01.095668Z\", \"started\": \"2024-01-21T07:40:05.102403Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi080\", \"container_id\": \"4a4be448f50b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50635735, \"cpu_percentage\": \"0.22%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685549Z\", \"created\": \"2024-01-21T07:40:28.143163Z\", \"started\": \"2024-01-21T07:40:31.788016Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi080\", \"container_image_name\": \"prom/node-exporter\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685813Z\", \"created\": \"2024-01-21T07:42:32.004437Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.bytdbv\", \"daemon_name\": \"rgw.r.z.smithi080.bytdbv\", \"hostname\": \"smithi080\", \"container_id\": \"f404329a2d0a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52638515, \"cpu_percentage\": \"0.32%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-01-21T07:51:03.685968Z\", \"created\": \"2024-01-21T07:44:46.357524Z\", \"started\": \"2024-01-21T07:44:46.381778Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi080\", \"container_id\": \"a9d41607da45\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 16158556, \"cpu_percentage\": \"0.13%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [9093, 9094], \"last_refresh\": \"2024-01-21T07:51:03.686214Z\", \"created\": \"2024-01-21T07:49:13.831545Z\", \"started\": \"2024-01-21T07:50:01.121470Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096921Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1daf8576-7e1e-44cc-8477-c8108442dd40\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"pDjMn5-KaNR-vVcc-f3qs-c3b2-fwHP-MdGxC1\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8761092d-c3ee-4a24-9d86-39182ffb54e3\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"lDY7NF-fhwX-O0cE-SLAT-kwT9-GPQq-X8l23T\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e40c68c3-96c6-45e5-875a-cd0b65d215ff\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"IY8uzc-SHHc-Bfcx-3Z3L-r5Mw-vPXH-x7148B\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9ef0e6e3-19f4-49c4-9074-c94be9e385bf\", \"cluster_fsid\": \"b86415d2-b82f-11ee-95b0-87774f69a715\", \"block_uuid\": \"9FjZ7Y-hf5G-qppG-5jy3-JqcD-EkXF-aDBYbO\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-01-21T07:48:50.096943Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM173_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-01-21T07:49:54.923647Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-01-21T07:50:30.145336Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:08.809755Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:33.121852Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-01-21T07:39:58.838625Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-01-21T07:40:25.930108Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:42:31.314438Z\"}, \"rgw.r.z.smithi080.bytdbv\": {\"deps\": [], \"last_config\": \"2024-01-21T07:44:43.864480Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-01-21T07:49:56.747434Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-01-21T07:51:28.356709Z\"}}, \"last_device_update\": \"2024-01-21T07:40:35.201453Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-01-21T07:48:34.461568Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-01-21T07:51:34.348 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:32.333048+0000 mgr.y (mgr.24922) 32 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:34.348 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:33.994041+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-01-21T07:51:34.348 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:33.999148+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:51:34.348 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.007566+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.008276+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.008347+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.009980+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e30: y(active, since 43s), standbys: x 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.029236+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e31: y(active, since 43s), standbys: x 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.031432+0000 mon.a (mon.0) 8 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.031484+0000 mon.a (mon.0) 9 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.031513+0000 mon.a (mon.0) 10 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: cluster 2024-01-21T07:51:34.031541+0000 mon.a (mon.0) 11 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:51:34.349 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[13978]: audit 2024-01-21T07:51:34.042603+0000 mon.a (mon.0) 12 : audit [INF] from='mgr.24922 ' entity='' 2024-01-21T07:51:34.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[29223]: debug 2024-01-21T07:51:34.340+0000 7f1f8eeb4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T07:51:35.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:34 smithi080 bash[36925]: debug 2024-01-21T07:51:34.772+0000 7fab0db76680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:51:35.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:34 smithi195 bash[29223]: debug 2024-01-21T07:51:34.776+0000 7f1f8eeb4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T07:51:36.011 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:35 smithi080 bash[36925]: debug 2024-01-21T07:51:35.668+0000 7fab0db76680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:51:36.011 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:35 smithi080 bash[36925]: debug 2024-01-21T07:51:35.760+0000 7fab0db76680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:51:36.037 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:35 smithi195 bash[29223]: debug 2024-01-21T07:51:35.699+0000 7f1f8eeb4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T07:51:36.037 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:35 smithi195 bash[29223]: debug 2024-01-21T07:51:35.795+0000 7f1f8eeb4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T07:51:36.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:36 smithi080 bash[38631]: cluster 2024-01-21T07:51:35.034621+0000 mon.a (mon.0) 13 : cluster [DBG] mgrmap e32: y(active, since 44s), standbys: x 2024-01-21T07:51:36.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:36 smithi080 bash[36925]: debug 2024-01-21T07:51:36.004+0000 7fab0db76680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:51:36.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:36 smithi080 bash[17460]: cluster 2024-01-21T07:51:35.034621+0000 mon.a (mon.0) 13 : cluster [DBG] mgrmap e32: y(active, since 44s), standbys: x 2024-01-21T07:51:36.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:36 smithi195 bash[29223]: debug 2024-01-21T07:51:36.047+0000 7f1f8eeb4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T07:51:36.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:36 smithi195 bash[13978]: cluster 2024-01-21T07:51:35.034621+0000 mon.a (mon.0) 13 : cluster [DBG] mgrmap e32: y(active, since 44s), standbys: x 2024-01-21T07:51:37.383 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:37 smithi080 bash[36925]: debug 2024-01-21T07:51:37.120+0000 7fab0db76680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:51:37.383 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:37 smithi080 bash[36925]: debug 2024-01-21T07:51:37.280+0000 7fab0db76680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:51:37.383 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:37 smithi080 bash[36925]: debug 2024-01-21T07:51:37.376+0000 7fab0db76680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:51:37.435 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:37 smithi195 bash[29223]: debug 2024-01-21T07:51:37.167+0000 7f1f8eeb4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T07:51:37.435 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:37 smithi195 bash[29223]: debug 2024-01-21T07:51:37.327+0000 7f1f8eeb4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:51:37.435 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:37 smithi195 bash[29223]: debug 2024-01-21T07:51:37.427+0000 7f1f8eeb4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T07:51:37.714 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:37 smithi080 bash[36925]: debug 2024-01-21T07:51:37.488+0000 7fab0db76680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:51:37.766 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:37 smithi195 bash[29223]: debug 2024-01-21T07:51:37.535+0000 7f1f8eeb4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T07:51:38.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:37 smithi080 bash[36925]: debug 2024-01-21T07:51:37.708+0000 7fab0db76680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:51:38.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:37 smithi195 bash[29223]: debug 2024-01-21T07:51:37.759+0000 7f1f8eeb4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T07:51:38.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:38 smithi080 bash[36925]: debug 2024-01-21T07:51:38.076+0000 7fab0db76680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:51:38.558 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:38 smithi080 bash[36925]: debug 2024-01-21T07:51:38.196+0000 7fab0db76680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:51:38.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:38 smithi195 bash[29223]: debug 2024-01-21T07:51:38.131+0000 7f1f8eeb4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T07:51:38.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:38 smithi195 bash[29223]: debug 2024-01-21T07:51:38.247+0000 7f1f8eeb4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T07:51:39.388 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:39 smithi195 bash[29223]: debug 2024-01-21T07:51:39.111+0000 7f1f8eeb4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:51:39.389 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:39 smithi195 bash[29223]: debug 2024-01-21T07:51:39.215+0000 7f1f8eeb4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:51:39.389 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:39 smithi195 bash[29223]: debug 2024-01-21T07:51:39.331+0000 7f1f8eeb4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:51:39.497 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:39 smithi080 bash[36925]: debug 2024-01-21T07:51:39.056+0000 7fab0db76680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T07:51:39.497 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:39 smithi080 bash[36925]: debug 2024-01-21T07:51:39.160+0000 7fab0db76680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T07:51:39.497 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:39 smithi080 bash[36925]: debug 2024-01-21T07:51:39.272+0000 7fab0db76680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T07:51:39.850 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:39 smithi195 bash[29223]: debug 2024-01-21T07:51:39.551+0000 7f1f8eeb4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:51:40.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:39 smithi080 bash[36925]: debug 2024-01-21T07:51:39.492+0000 7fab0db76680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T07:51:40.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:39 smithi080 bash[36925]: debug 2024-01-21T07:51:39.780+0000 7fab0db76680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:51:40.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:39 smithi080 bash[36925]: debug 2024-01-21T07:51:39.944+0000 7fab0db76680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:51:40.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:39 smithi195 bash[29223]: debug 2024-01-21T07:51:39.843+0000 7f1f8eeb4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T07:51:40.138 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: debug 2024-01-21T07:51:40.007+0000 7f1f8eeb4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T07:51:40.452 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[36925]: debug 2024-01-21T07:51:40.120+0000 7fab0db76680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:51:40.452 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[36925]: debug 2024-01-21T07:51:40.336+0000 7fab0db76680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:51:40.452 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[36925]: debug 2024-01-21T07:51:40.444+0000 7fab0db76680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:51:40.518 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: debug 2024-01-21T07:51:40.183+0000 7f1f8eeb4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T07:51:40.518 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: debug 2024-01-21T07:51:40.399+0000 7f1f8eeb4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T07:51:40.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[38631]: cluster 2024-01-21T07:51:40.472683+0000 mon.a (mon.0) 14 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:51:40.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[38631]: cluster 2024-01-21T07:51:40.473712+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-01-21T07:51:40.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[38631]: cluster 2024-01-21T07:51:40.481491+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:51:40.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[38631]: cluster 2024-01-21T07:51:40.484896+0000 mon.a (mon.0) 17 : cluster [DBG] mgrmap e33: y(active, starting, since 0.0114887s), standbys: x 2024-01-21T07:51:40.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[17460]: cluster 2024-01-21T07:51:40.472683+0000 mon.a (mon.0) 14 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:51:40.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[17460]: cluster 2024-01-21T07:51:40.473712+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-01-21T07:51:40.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[17460]: cluster 2024-01-21T07:51:40.481491+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:51:40.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:40 smithi080 bash[17460]: cluster 2024-01-21T07:51:40.484896+0000 mon.a (mon.0) 17 : cluster [DBG] mgrmap e33: y(active, starting, since 0.0114887s), standbys: x 2024-01-21T07:51:40.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[13978]: cluster 2024-01-21T07:51:40.472683+0000 mon.a (mon.0) 14 : cluster [INF] Active manager daemon y restarted 2024-01-21T07:51:40.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[13978]: cluster 2024-01-21T07:51:40.473712+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-01-21T07:51:40.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[13978]: cluster 2024-01-21T07:51:40.481491+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:51:40.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[13978]: cluster 2024-01-21T07:51:40.484896+0000 mon.a (mon.0) 17 : cluster [DBG] mgrmap e33: y(active, starting, since 0.0114887s), standbys: x 2024-01-21T07:51:40.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: debug 2024-01-21T07:51:40.507+0000 7f1f8eeb4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T07:51:40.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: [21/Jan/2024:07:51:40] ENGINE Bus STARTING 2024-01-21T07:51:40.890 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: CherryPy Checker: 2024-01-21T07:51:40.890 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: The Application mounted at '' has an empty config. 2024-01-21T07:51:40.890 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: [21/Jan/2024:07:51:40] ENGINE Serving on http://:::9283 2024-01-21T07:51:40.890 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:40 smithi195 bash[29223]: [21/Jan/2024:07:51:40] ENGINE Bus STARTED 2024-01-21T07:51:41.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[38631]: cluster 2024-01-21T07:51:40.539807+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:51:41.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[38631]: cluster 2024-01-21T07:51:40.539879+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:51:41.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[38631]: audit 2024-01-21T07:51:40.541977+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[38631]: audit 2024-01-21T07:51:40.544976+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[38631]: audit 2024-01-21T07:51:40.549403+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[38631]: audit 2024-01-21T07:51:40.552179+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[17460]: cluster 2024-01-21T07:51:40.539807+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[17460]: cluster 2024-01-21T07:51:40.539879+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[17460]: audit 2024-01-21T07:51:40.541977+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[17460]: audit 2024-01-21T07:51:40.544976+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[17460]: audit 2024-01-21T07:51:40.549403+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:51:41.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:41 smithi080 bash[17460]: audit 2024-01-21T07:51:40.552179+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:41 smithi195 bash[13978]: cluster 2024-01-21T07:51:40.539807+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2024-01-21T07:51:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:41 smithi195 bash[13978]: cluster 2024-01-21T07:51:40.539879+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2024-01-21T07:51:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:41 smithi195 bash[13978]: audit 2024-01-21T07:51:40.541977+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-21T07:51:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:41 smithi195 bash[13978]: audit 2024-01-21T07:51:40.544976+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:41 smithi195 bash[13978]: audit 2024-01-21T07:51:40.549403+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-21T07:51:41.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:41 smithi195 bash[13978]: audit 2024-01-21T07:51:40.552179+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.? 172.21.15.195:0/1125632671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:42.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:42 smithi080 bash[38631]: cluster 2024-01-21T07:51:41.549254+0000 mon.a (mon.0) 20 : cluster [DBG] mgrmap e34: y(active, starting, since 1.07584s), standbys: x 2024-01-21T07:51:42.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:42 smithi080 bash[38631]: audit 2024-01-21T07:51:41.549520+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.? 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:51:42.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:42 smithi080 bash[38631]: audit 2024-01-21T07:51:41.549942+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.? 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:51:42.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:42 smithi080 bash[17460]: cluster 2024-01-21T07:51:41.549254+0000 mon.a (mon.0) 20 : cluster [DBG] mgrmap e34: y(active, starting, since 1.07584s), standbys: x 2024-01-21T07:51:42.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:42 smithi080 bash[17460]: audit 2024-01-21T07:51:41.549520+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.? 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:51:42.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:42 smithi080 bash[17460]: audit 2024-01-21T07:51:41.549942+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.? 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:51:42.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:42 smithi195 bash[13978]: cluster 2024-01-21T07:51:41.549254+0000 mon.a (mon.0) 20 : cluster [DBG] mgrmap e34: y(active, starting, since 1.07584s), standbys: x 2024-01-21T07:51:42.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:42 smithi195 bash[13978]: audit 2024-01-21T07:51:41.549520+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.? 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-21T07:51:42.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:42 smithi195 bash[13978]: audit 2024-01-21T07:51:41.549942+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.? 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-21T07:51:44.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:51:44 smithi080 bash[36089]: level=warn ts=2024-01-21T07:51:44.238Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:51:46.606 INFO:teuthology.orchestra.run.smithi080.stderr:Error ENOTSUP: Warning: due to ceph-mgr restart, some PG states may not be up to date 2024-01-21T07:51:46.606 INFO:teuthology.orchestra.run.smithi080.stderr:Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2024-01-21T07:51:46.796 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: debug 2024-01-21T07:51:46.596+0000 7faad1343700 -1 mgr.server reply reply (95) Operation not supported Warning: due to ceph-mgr restart, some PG states may not be up to date 2024-01-21T07:51:46.796 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2024-01-21T07:51:46.796 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: debug 2024-01-21T07:51:46.604+0000 7faad1343700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-01-21T07:51:46.796 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-01-21T07:51:46.796 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: [21/Jan/2024:07:51:46] ENGINE Bus STARTING 2024-01-21T07:51:46.796 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: Warning: Permanently added '172.21.15.195' (ECDSA) to the list of known hosts. 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.488746+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.489433+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.489919+0000 mon.a (mon.0) 25 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.493373+0000 mon.a (mon.0) 26 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.494073+0000 mon.a (mon.0) 27 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.494514+0000 mon.a (mon.0) 28 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.494974+0000 mon.a (mon.0) 29 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.495409+0000 mon.a (mon.0) 30 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.495816+0000 mon.a (mon.0) 31 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:51:46.797 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.496181+0000 mon.a (mon.0) 32 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.496557+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.496968+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.497269+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.498102+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.499921+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.501747+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.502360+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.503103+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.488746+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.489433+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:51:46.798 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.489919+0000 mon.a (mon.0) 25 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.493373+0000 mon.a (mon.0) 26 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.494073+0000 mon.a (mon.0) 27 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.494514+0000 mon.a (mon.0) 28 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.494974+0000 mon.a (mon.0) 29 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.495409+0000 mon.a (mon.0) 30 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.495816+0000 mon.a (mon.0) 31 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.496181+0000 mon.a (mon.0) 32 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.496557+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.496968+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.497269+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.498102+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.499921+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.501747+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:51:46.799 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.502360+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.503103+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.503755+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.504360+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.504940+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.505383+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.505850+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_crt"}]: dispatch 2024-01-21T07:51:46.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.506283+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_key"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.506777+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.507308+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.507803+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.508320+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.508819+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.509309+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.509799+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.510304+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.510801+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.511313+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.511792+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.512277+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.512754+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.513233+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:51:46.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.513711+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/prometheus/health_history"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.514212+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: audit 2024-01-21T07:51:46.514710+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[38631]: cluster 2024-01-21T07:51:46.535502+0000 mon.a (mon.0) 64 : cluster [INF] Manager daemon y is now available 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.503755+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.504360+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.504940+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.505383+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:51:46.802 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.505850+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_crt"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.506283+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_key"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.506777+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.507308+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.507803+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.508320+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.508819+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.509309+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.509799+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.510304+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.510801+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.511313+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.511792+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.512277+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.512754+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:51:46.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.513233+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:51:46.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.513711+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/prometheus/health_history"}]: dispatch 2024-01-21T07:51:46.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.514212+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:51:46.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: audit 2024-01-21T07:51:46.514710+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:51:46.804 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[17460]: cluster 2024-01-21T07:51:46.535502+0000 mon.a (mon.0) 64 : cluster [INF] Manager daemon y is now available 2024-01-21T07:51:46.804 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.488746+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.489433+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.489919+0000 mon.a (mon.0) 25 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.493373+0000 mon.a (mon.0) 26 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.494073+0000 mon.a (mon.0) 27 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.494514+0000 mon.a (mon.0) 28 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.494974+0000 mon.a (mon.0) 29 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.495409+0000 mon.a (mon.0) 30 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.495816+0000 mon.a (mon.0) 31 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.496181+0000 mon.a (mon.0) 32 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.496557+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-21T07:51:46.805 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.496968+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.497269+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.498102+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.499921+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.501747+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.502360+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.503103+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.503755+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.504360+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.504940+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.505383+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.505850+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_crt"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.506283+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi195/grafana_key"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.506777+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-01-21T07:51:46.806 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.507308+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.507803+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.508320+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.508819+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.509309+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.509799+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.510304+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.510801+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.511313+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.511792+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.512277+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.512754+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.513233+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.513711+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/prometheus/health_history"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.514212+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: audit 2024-01-21T07:51:46.514710+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-01-21T07:51:46.807 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:46 smithi195 bash[13978]: cluster 2024-01-21T07:51:46.535502+0000 mon.a (mon.0) 64 : cluster [INF] Manager daemon y is now available 2024-01-21T07:51:47.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: CherryPy Checker: 2024-01-21T07:51:47.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: The Application mounted at '' has an empty config. 2024-01-21T07:51:47.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: [21/Jan/2024:07:51:46] ENGINE Serving on http://:::9283 2024-01-21T07:51:47.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:46 smithi080 bash[36925]: [21/Jan/2024:07:51:46] ENGINE Bus STARTED 2024-01-21T07:51:47.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph orch ps' 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: cluster 2024-01-21T07:51:46.598181+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e35: y(active, since 6s), standbys: x 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:46.600338+0000 mgr.y (mgr.44103) 1 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: cluster 2024-01-21T07:51:46.611259+0000 mgr.y (mgr.44103) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:46.704689+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:46.707557+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:46.784480+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:46.803415+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:47.113917+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:47.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:47 smithi195 bash[13978]: audit 2024-01-21T07:51:47.114324+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: cluster 2024-01-21T07:51:46.598181+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e35: y(active, since 6s), standbys: x 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:46.600338+0000 mgr.y (mgr.44103) 1 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: cluster 2024-01-21T07:51:46.611259+0000 mgr.y (mgr.44103) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:46.704689+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:46.707557+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:46.784480+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:51:48.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:46.803415+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:47.113917+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[17460]: audit 2024-01-21T07:51:47.114324+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: cluster 2024-01-21T07:51:46.598181+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e35: y(active, since 6s), standbys: x 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:46.600338+0000 mgr.y (mgr.44103) 1 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: cluster 2024-01-21T07:51:46.611259+0000 mgr.y (mgr.44103) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:46.704689+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:46.707557+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:46.784480+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:46.803415+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:47.113917+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:48.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:47 smithi080 bash[38631]: audit 2024-01-21T07:51:47.114324+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:51:48.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:51:48 smithi080 bash[36089]: level=info ts=2024-01-21T07:51:48.165Z caller=notify.go:735 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify success" attempts=5 2024-01-21T07:51:48.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:48 smithi080 bash[38631]: cluster 2024-01-21T07:51:47.592010+0000 mon.a (mon.0) 72 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:51:48.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:48 smithi080 bash[38631]: cluster 2024-01-21T07:51:47.592077+0000 mon.a (mon.0) 73 : cluster [INF] Cluster is now healthy 2024-01-21T07:51:48.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:48 smithi080 bash[17460]: cluster 2024-01-21T07:51:47.592010+0000 mon.a (mon.0) 72 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:51:48.860 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:48 smithi080 bash[17460]: cluster 2024-01-21T07:51:47.592077+0000 mon.a (mon.0) 73 : cluster [INF] Cluster is now healthy 2024-01-21T07:51:48.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:48 smithi195 bash[13978]: cluster 2024-01-21T07:51:47.592010+0000 mon.a (mon.0) 72 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2024-01-21T07:51:48.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:48 smithi195 bash[13978]: cluster 2024-01-21T07:51:47.592077+0000 mon.a (mon.0) 73 : cluster [INF] Cluster is now healthy 2024-01-21T07:51:49.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:49 smithi080 bash[38631]: cluster 2024-01-21T07:51:48.495763+0000 mgr.y (mgr.44103) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:49.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:49 smithi080 bash[38631]: cluster 2024-01-21T07:51:48.621322+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e36: y(active, since 8s), standbys: x 2024-01-21T07:51:49.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:49 smithi080 bash[17460]: cluster 2024-01-21T07:51:48.495763+0000 mgr.y (mgr.44103) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:49.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:49 smithi080 bash[17460]: cluster 2024-01-21T07:51:48.621322+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e36: y(active, since 8s), standbys: x 2024-01-21T07:51:49.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:49 smithi195 bash[13978]: cluster 2024-01-21T07:51:48.495763+0000 mgr.y (mgr.44103) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:49.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:49 smithi195 bash[13978]: cluster 2024-01-21T07:51:48.621322+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e36: y(active, since 8s), standbys: x 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:alertmanager.a smithi080 *:9093,9094 running (109s) 46s ago 2m 15.4M - 0.23.0 ba2b418f427c a9d41607da45 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (84s) 24s ago 8m 24.6M - 6.6.2 87a51ecf0b1c ccb48473f95f 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 *:8443,9283 running (30s) 24s ago 12m 84.9M - 16.2.14-454-gea310589 9b28eb2d7c37 2a953d798d62 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 *:8443,9283 running (67s) 46s ago 15m 409M - 16.2.14-454-gea310589 9b28eb2d7c37 8c9e9c0849f8 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 starting - - - 2048M 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (13m) 24s ago 13m 107M 2048M 15.2.0 204a01f9b0b6 ee6227a186a5 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (13m) 46s ago 13m 102M 2048M 15.2.0 204a01f9b0b6 ead96e485721 2024-01-21T07:51:50.525 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 46s ago 9m - - 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 24s ago 9m - - 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (12m) 46s ago 12m 51.3M 4096M 15.2.0 204a01f9b0b6 960abfd97f90 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (12m) 46s ago 12m 51.8M 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (11m) 46s ago 11m 45.8M 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (11m) 46s ago 11m 48.2M 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (10m) 24s ago 11m 48.8M 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (10m) 24s ago 10m 48.3M 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (10m) 24s ago 10m 47.2M 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (9m) 24s ago 9m 49.8M 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:prometheus.a smithi195 *:9095 running (2m) 24s ago 2m 43.7M - 2.33.4 514e6a882f6e 9c7157bf1685 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (7m) 46s ago 7m 50.2M - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:51:50.526 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (7m) 24s ago 7m 49.8M - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.503878+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.504830+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.505741+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.506686+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.507414+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.508197+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.510812+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.511548+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.512261+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.512922+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:50.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:50 smithi195 bash[13978]: audit 2024-01-21T07:51:50.513567+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.503878+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.504830+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.505741+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.506686+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.507414+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.508197+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.510812+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.511548+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.512261+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.512922+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[38631]: audit 2024-01-21T07:51:50.513567+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.503878+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.504830+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.505741+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.506686+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.507414+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.508197+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.510812+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.511548+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.512261+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.060 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.512922+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:50 smithi080 bash[17460]: audit 2024-01-21T07:51:50.513567+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:51.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph versions' 2024-01-21T07:51:51.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:51 smithi195 bash[13978]: cluster 2024-01-21T07:51:50.496446+0000 mgr.y (mgr.44103) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:51.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:51 smithi195 bash[13978]: audit 2024-01-21T07:51:50.498147+0000 mgr.y (mgr.44103) 5 : audit [DBG] from='client.44130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:51 smithi080 bash[38631]: cluster 2024-01-21T07:51:50.496446+0000 mgr.y (mgr.44103) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:52.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:51 smithi080 bash[38631]: audit 2024-01-21T07:51:50.498147+0000 mgr.y (mgr.44103) 5 : audit [DBG] from='client.44130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:51 smithi080 bash[17460]: cluster 2024-01-21T07:51:50.496446+0000 mgr.y (mgr.44103) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:52.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:51 smithi080 bash[17460]: audit 2024-01-21T07:51:50.498147+0000 mgr.y (mgr.44103) 5 : audit [DBG] from='client.44130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:51:53.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:51:52 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:52] "GET /metrics HTTP/1.1" 200 152391 "" "Prometheus/2.33.4" 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: cluster 2024-01-21T07:51:52.498081+0000 mgr.y (mgr.44103) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.309680+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.467777+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.568932+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.569986+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.570905+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.571665+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.572418+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.573187+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.573949+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.574744+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[38631]: audit 2024-01-21T07:51:53.575485+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: cluster 2024-01-21T07:51:52.498081+0000 mgr.y (mgr.44103) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.309680+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.467777+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.568932+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.569986+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.570905+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.571665+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.572418+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.573187+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.573949+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.574744+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:53.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:53 smithi080 bash[17460]: audit 2024-01-21T07:51:53.575485+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: cluster 2024-01-21T07:51:52.498081+0000 mgr.y (mgr.44103) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.309680+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.467777+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.568932+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.569986+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.570905+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:54.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.571665+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:54.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.572418+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:54.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.573187+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:54.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.573949+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:54.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.574744+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:54.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:53 smithi195 bash[13978]: audit 2024-01-21T07:51:53.575485+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:54.204 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:51:54.204 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:51:54.204 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-01-21T07:51:54.204 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 1 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 2 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 3 2024-01-21T07:51:54.205 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:51:54.206 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:51:55.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.742847+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.743428+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.743968+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.744560+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.745274+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.746121+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.747228+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.749638+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.752454+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.759609+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.770723+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.775738+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.778000+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:51:55.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:53.779065+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: cephadm 2024-01-21T07:51:53.779896+0000 mgr.y (mgr.44103) 8 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[38631]: audit 2024-01-21T07:51:54.202265+0000 mon.c (mon.1) 149 : audit [DBG] from='client.44136 172.21.15.80:0/2684044179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.742847+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.743428+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.743968+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.744560+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.745274+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.746121+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.747228+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.749638+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.752454+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.759609+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.770723+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.775738+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.778000+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:53.779065+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: cephadm 2024-01-21T07:51:53.779896+0000 mgr.y (mgr.44103) 8 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-01-21T07:51:55.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:54 smithi080 bash[17460]: audit 2024-01-21T07:51:54.202265+0000 mon.c (mon.1) 149 : audit [DBG] from='client.44136 172.21.15.80:0/2684044179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.742847+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.743428+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.743968+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.744560+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.745274+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.746121+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.747228+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.749638+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.752454+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.759609+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.770723+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.775738+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.778000+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:53.779065+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: cephadm 2024-01-21T07:51:53.779896+0000 mgr.y (mgr.44103) 8 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-01-21T07:51:55.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:54 smithi195 bash[13978]: audit 2024-01-21T07:51:54.202265+0000 mon.c (mon.1) 149 : audit [DBG] from='client.44136 172.21.15.80:0/2684044179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:51:55.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-01-21T07:51:55.701 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:55 smithi080 bash[38631]: cluster 2024-01-21T07:51:54.640676+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:51:55.701 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:55 smithi080 bash[17460]: cluster 2024-01-21T07:51:54.640676+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:51:56.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:55 smithi195 bash[13978]: cluster 2024-01-21T07:51:54.640676+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-01-21T07:51:56.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:56 smithi080 bash[38631]: cluster 2024-01-21T07:51:55.755091+0000 mgr.y (mgr.44103) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:56.808 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:56 smithi080 bash[17460]: cluster 2024-01-21T07:51:55.755091+0000 mgr.y (mgr.44103) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:57.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:56 smithi195 bash[13978]: cluster 2024-01-21T07:51:55.755091+0000 mgr.y (mgr.44103) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:57.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:51:56 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:51:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:51:58.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: cephadm 2024-01-21T07:51:56.892584+0000 mgr.y (mgr.44103) 10 : cephadm [INF] Upgrade: Updating mon.c 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: audit 2024-01-21T07:51:56.898307+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: audit 2024-01-21T07:51:56.900041+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: audit 2024-01-21T07:51:56.901497+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: audit 2024-01-21T07:51:56.903085+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: cephadm 2024-01-21T07:51:56.904618+0000 mgr.y (mgr.44103) 11 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[38631]: audit 2024-01-21T07:51:56.905687+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: cephadm 2024-01-21T07:51:56.892584+0000 mgr.y (mgr.44103) 10 : cephadm [INF] Upgrade: Updating mon.c 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: audit 2024-01-21T07:51:56.898307+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: audit 2024-01-21T07:51:56.900041+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: audit 2024-01-21T07:51:56.901497+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:58.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: audit 2024-01-21T07:51:56.903085+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:58.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: cephadm 2024-01-21T07:51:56.904618+0000 mgr.y (mgr.44103) 11 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-01-21T07:51:58.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:57 smithi080 bash[17460]: audit 2024-01-21T07:51:56.905687+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: cephadm 2024-01-21T07:51:56.892584+0000 mgr.y (mgr.44103) 10 : cephadm [INF] Upgrade: Updating mon.c 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: audit 2024-01-21T07:51:56.898307+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: audit 2024-01-21T07:51:56.900041+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: audit 2024-01-21T07:51:56.901497+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: audit 2024-01-21T07:51:56.903085+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: cephadm 2024-01-21T07:51:56.904618+0000 mgr.y (mgr.44103) 11 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-01-21T07:51:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:57 smithi195 bash[13978]: audit 2024-01-21T07:51:56.905687+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:51:59.206 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:51:58 smithi080 bash[38631]: cluster 2024-01-21T07:51:57.756593+0000 mgr.y (mgr.44103) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:59.206 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:51:58 smithi080 bash[17460]: cluster 2024-01-21T07:51:57.756593+0000 mgr.y (mgr.44103) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:51:58 smithi195 bash[13978]: cluster 2024-01-21T07:51:57.756593+0000 mgr.y (mgr.44103) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:51:59.932 INFO:teuthology.orchestra.run.smithi080.stdout:wait for servicemap items w/ changing names to refresh 2024-01-21T07:52:00.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:00 smithi080 systemd[1]: Stopping Ceph mon.c for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:52:00.779 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'sleep 60' 2024-01-21T07:52:01.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:00 smithi080 bash[17460]: debug 2024-01-21T07:52:00.663+0000 7f8a5738e700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:52:01.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:00 smithi080 bash[17460]: debug 2024-01-21T07:52:00.663+0000 7f8a5738e700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-01-21T07:52:01.558 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:01 smithi080 bash[40165]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.c 2024-01-21T07:52:01.997 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:01 smithi080 bash[40230]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.c 2024-01-21T07:52:01.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:01 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.c.service: Succeeded. 2024-01-21T07:52:01.998 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:01 smithi080 systemd[1]: Stopped Ceph mon.c for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:52:02.278 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:02 smithi080 systemd[1]: Started Ceph mon.c for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:52:03.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:02 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:02] "GET /metrics HTTP/1.1" 200 152395 "" "Prometheus/2.33.4" 2024-01-21T07:52:04.490 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.307+0000 7f5431e36880 0 set uid:gid to 167:167 (ceph:ceph) 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.307+0000 7f5431e36880 0 ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable), process ceph-mon, pid 7 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.307+0000 7f5431e36880 0 pidfile_write: ignore empty --pid-file 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 0 load: jerasure load: lrc load: isa 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: RocksDB version: 6.8.1 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Compile date Jan 19 2024 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: DB SUMMARY 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: CURRENT file: CURRENT 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: IDENTITY file: IDENTITY 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 1034 Bytes 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000028.sst 000029.sst 2024-01-21T07:52:04.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000026.log size: 27415083 ; 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.create_if_missing: 0 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.env: 0x55c6c821f080 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.fs: Posix File System 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.info_log: 0x55c6c9236220 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:52:04.492 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.db_log_dir: 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:52:04.493 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.write_buffer_manager: 0x55c6c9f2a390 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.unordered_write: 0 2024-01-21T07:52:04.494 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.row_cache: None 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.wal_filter: None 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.log_readahead_size: 0 2024-01-21T07:52:04.495 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:52:04.496 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:52:04.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:52:04.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:52:04.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:52:04.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:52:04.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:52:04.497 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Compression algorithms supported: 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kZSTD supported: 0 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.merge_operator: 2024-01-21T07:52:04.498 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c6c91d9d28) 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: cache_index_and_filter_blocks: 1 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: pin_top_level_index_and_filter: 1 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: index_type: 0 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: data_block_index_type: 0 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: index_shortening: 1 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:52:04.499 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: hash_index_allow_collision: 1 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: checksum: 1 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: no_block_cache: 0 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_cache: 0x55c6c9210f10 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_cache_name: BinnedLRUCache 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_cache_options: 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: capacity : 536870912 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: num_shard_bits : 4 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: strict_capacity_limit : 0 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: high_pri_pool_ratio: 0.000 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_cache_compressed: (nil) 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: persistent_cache: (nil) 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_size: 4096 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_size_deviation: 10 2024-01-21T07:52:04.500 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_restart_interval: 16 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: index_block_restart_interval: 1 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: metadata_block_size: 4096 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: partition_filters: 0 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: use_delta_encoding: 1 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: whole_key_filtering: 1 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: verify_compression: 0 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: read_amp_bytes_per_bit: 0 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: format_version: 2 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: enable_index_compression: 1 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: block_align: 0 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:52:04.501 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.num_levels: 7 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:52:04.502 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:52:04.503 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:52:04.504 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:52:04.505 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.ttl: 2592000 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.311+0000 7f5431e36880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.315+0000 7f5431e36880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 31, last_sequence is 11621, log_number is 26,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.315+0000 7f5431e36880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 26 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.315+0000 7f5431e36880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823524319255, "job": 1, "event": "recovery_started", "log_files": [26]} 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.315+0000 7f5431e36880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #26 mode 2 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.343+0000 7f5431e36880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-01-21T07:52:04.506 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.375+0000 7f5431e36880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823524378504, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 31, "file_size": 18077815, "table_properties": {"data_size": 18066054, "index_size": 9721, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1221, "raw_key_size": 9838, "raw_average_key_size": 21, "raw_value_size": 18052114, "raw_average_value_size": 39243, "num_data_blocks": 304, "num_entries": 460, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1705823524, "oldest_key_time": 3, "file_creation_time": 0}} 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.375+0000 7f5431e36880 4 rocksdb: [version_set.cc:3826] Creating manifest 32 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.375+0000 7f5431e36880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823524379749, "job": 1, "event": "recovery_finished"} 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.379+0000 7f5431e36880 4 rocksdb: DB pointer 0x55c6c92d9800 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.379+0000 7f5418c28700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.379+0000 7f5418c28700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** DB Stats ** 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Uptime(secs): 0.1 total, 0.1 interval 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** Compaction Stats [default] ** 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: L0 1/0 17.24 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: L6 2/0 90.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Sum 3/0 107.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** Compaction Stats [default] ** 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Uptime(secs): 0.1 total, 0.1 interval 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Flush(GB): cumulative 0.017, interval 0.017 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Cumulative compaction: 0.02 GB write, 251.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Interval compaction: 0.02 GB write, 251.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** Compaction Stats [default] ** 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: L0 1/0 17.24 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: L6 2/0 90.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Sum 3/0 107.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** Compaction Stats [default] ** 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 604.5 0.03 0.00 1 0.029 0 0 2024-01-21T07:52:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Uptime(secs): 0.1 total, 0.0 interval 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Flush(GB): cumulative 0.017, interval 0.000 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Cumulative compaction: 0.02 GB write, 251.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.383+0000 7f5431e36880 0 starting mon.c rank 1 at public addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] at bind addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.383+0000 7f5431e36880 1 mon.c@-1(???) e3 preinit fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.383+0000 7f5431e36880 0 mon.c@-1(???).mds e1 new map 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.383+0000 7f5431e36880 0 mon.c@-1(???).mds e1 print_map 2024-01-21T07:52:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: e1 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: enable_multiple, ever_enabled_multiple: 0,0 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: legacy client fscid: -1 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: No filesystems configured 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.387+0000 7f5431e36880 0 mon.c@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.387+0000 7f5431e36880 0 mon.c@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.387+0000 7f5431e36880 0 mon.c@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.387+0000 7f5431e36880 0 mon.c@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: cluster 2024-01-21T07:51:57.756593+0000 mgr.y (mgr.44103) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:04 smithi080 bash[40414]: debug 2024-01-21T07:52:04.387+0000 7f5431e36880 1 mon.c@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-01-21T07:52:07.136 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:52:06 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:52:07.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:07 smithi195 bash[13978]: cluster 2024-01-21T07:51:59.757300+0000 mgr.y (mgr.44103) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:07.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:07 smithi080 bash[38631]: cluster 2024-01-21T07:51:59.757300+0000 mgr.y (mgr.44103) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:07.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:07 smithi080 bash[40414]: cluster 2024-01-21T07:51:59.757300+0000 mgr.y (mgr.44103) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:01.758647+0000 mgr.y (mgr.44103) 14 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:03.759354+0000 mgr.y (mgr.44103) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:04.608628+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:05.760119+0000 mgr.y (mgr.44103) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.125790+0000 mon.a (mon.0) 117 : cluster [INF] mon.a calling monitor election 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.129413+0000 mon.a (mon.0) 118 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.137524+0000 mon.a (mon.0) 119 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.138607+0000 mon.a (mon.0) 120 : cluster [DBG] fsmap 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.138677+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:52:08.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.139307+0000 mon.a (mon.0) 122 : cluster [DBG] mgrmap e36: y(active, since 26s), standbys: x 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.146110+0000 mon.a (mon.0) 123 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.146139+0000 mon.a (mon.0) 124 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.146156+0000 mon.a (mon.0) 125 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.146170+0000 mon.a (mon.0) 126 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: audit 2024-01-21T07:52:07.151212+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: audit 2024-01-21T07:52:07.152967+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: audit 2024-01-21T07:52:07.156233+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[38631]: cluster 2024-01-21T07:52:07.761636+0000 mgr.y (mgr.44103) 17 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:01.758647+0000 mgr.y (mgr.44103) 14 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:03.759354+0000 mgr.y (mgr.44103) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:04.608628+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:05.760119+0000 mgr.y (mgr.44103) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.125790+0000 mon.a (mon.0) 117 : cluster [INF] mon.a calling monitor election 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.129413+0000 mon.a (mon.0) 118 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.137524+0000 mon.a (mon.0) 119 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.138607+0000 mon.a (mon.0) 120 : cluster [DBG] fsmap 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.138677+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.139307+0000 mon.a (mon.0) 122 : cluster [DBG] mgrmap e36: y(active, since 26s), standbys: x 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.146110+0000 mon.a (mon.0) 123 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.146139+0000 mon.a (mon.0) 124 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.146156+0000 mon.a (mon.0) 125 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.146170+0000 mon.a (mon.0) 126 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: audit 2024-01-21T07:52:07.151212+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: audit 2024-01-21T07:52:07.152967+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:08.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: audit 2024-01-21T07:52:07.156233+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:52:08.562 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:08 smithi080 bash[40414]: cluster 2024-01-21T07:52:07.761636+0000 mgr.y (mgr.44103) 17 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:01.758647+0000 mgr.y (mgr.44103) 14 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:03.759354+0000 mgr.y (mgr.44103) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:04.608628+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-01-21T07:52:08.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:05.760119+0000 mgr.y (mgr.44103) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:08.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.125790+0000 mon.a (mon.0) 117 : cluster [INF] mon.a calling monitor election 2024-01-21T07:52:08.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.129413+0000 mon.a (mon.0) 118 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.137524+0000 mon.a (mon.0) 119 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.138607+0000 mon.a (mon.0) 120 : cluster [DBG] fsmap 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.138677+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.139307+0000 mon.a (mon.0) 122 : cluster [DBG] mgrmap e36: y(active, since 26s), standbys: x 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.146110+0000 mon.a (mon.0) 123 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.146139+0000 mon.a (mon.0) 124 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.146156+0000 mon.a (mon.0) 125 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.146170+0000 mon.a (mon.0) 126 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: audit 2024-01-21T07:52:07.151212+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: audit 2024-01-21T07:52:07.152967+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: audit 2024-01-21T07:52:07.156233+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:52:08.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:08 smithi195 bash[13978]: cluster 2024-01-21T07:52:07.761636+0000 mgr.y (mgr.44103) 17 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:09.808 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:09 smithi080 bash[36925]: debug 2024-01-21T07:52:09.399+0000 7faad1343700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-21T07:52:10.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:10 smithi080 bash[38631]: cluster 2024-01-21T07:52:09.762365+0000 mgr.y (mgr.44103) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:10.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:10 smithi080 bash[40414]: cluster 2024-01-21T07:52:09.762365+0000 mgr.y (mgr.44103) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:10.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:10 smithi195 bash[13978]: cluster 2024-01-21T07:52:09.762365+0000 mgr.y (mgr.44103) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:13.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:12 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:12] "GET /metrics HTTP/1.1" 200 152395 "" "Prometheus/2.33.4" 2024-01-21T07:52:13.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:12 smithi080 bash[38631]: cluster 2024-01-21T07:52:11.763801+0000 mgr.y (mgr.44103) 19 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:13.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:12 smithi080 bash[40414]: cluster 2024-01-21T07:52:11.763801+0000 mgr.y (mgr.44103) 19 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:13.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:12 smithi195 bash[13978]: cluster 2024-01-21T07:52:11.763801+0000 mgr.y (mgr.44103) 19 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: audit 2024-01-21T07:52:13.104541+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: cluster 2024-01-21T07:52:13.106822+0000 mgr.y (mgr.44103) 20 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: cluster 2024-01-21T07:52:13.107382+0000 mgr.y (mgr.44103) 21 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: audit 2024-01-21T07:52:13.116085+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: audit 2024-01-21T07:52:13.127916+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: audit 2024-01-21T07:52:13.132142+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: audit 2024-01-21T07:52:13.134285+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: audit 2024-01-21T07:52:13.135596+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-21T07:52:14.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:14 smithi195 bash[13978]: cephadm 2024-01-21T07:52:13.136416+0000 mgr.y (mgr.44103) 22 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-01-21T07:52:14.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: audit 2024-01-21T07:52:13.104541+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: cluster 2024-01-21T07:52:13.106822+0000 mgr.y (mgr.44103) 20 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: cluster 2024-01-21T07:52:13.107382+0000 mgr.y (mgr.44103) 21 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: audit 2024-01-21T07:52:13.116085+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: audit 2024-01-21T07:52:13.127916+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: audit 2024-01-21T07:52:13.132142+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: audit 2024-01-21T07:52:13.134285+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: audit 2024-01-21T07:52:13.135596+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[38631]: cephadm 2024-01-21T07:52:13.136416+0000 mgr.y (mgr.44103) 22 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: audit 2024-01-21T07:52:13.104541+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: cluster 2024-01-21T07:52:13.106822+0000 mgr.y (mgr.44103) 20 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: cluster 2024-01-21T07:52:13.107382+0000 mgr.y (mgr.44103) 21 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:14.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: audit 2024-01-21T07:52:13.116085+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:14.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: audit 2024-01-21T07:52:13.127916+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:14.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: audit 2024-01-21T07:52:13.132142+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:14.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: audit 2024-01-21T07:52:13.134285+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-21T07:52:14.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: audit 2024-01-21T07:52:13.135596+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-21T07:52:14.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:14 smithi080 bash[40414]: cephadm 2024-01-21T07:52:13.136416+0000 mgr.y (mgr.44103) 22 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: cluster 2024-01-21T07:52:15.108092+0000 mgr.y (mgr.44103) 23 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: cephadm 2024-01-21T07:52:15.125207+0000 mgr.y (mgr.44103) 24 : cephadm [INF] Upgrade: Updating mon.b 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: audit 2024-01-21T07:52:15.133928+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: audit 2024-01-21T07:52:15.135697+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: audit 2024-01-21T07:52:15.137301+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: audit 2024-01-21T07:52:15.139023+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: cephadm 2024-01-21T07:52:15.140461+0000 mgr.y (mgr.44103) 25 : cephadm [INF] Deploying daemon mon.b on smithi195 2024-01-21T07:52:16.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[13978]: audit 2024-01-21T07:52:15.141283+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:16.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: cluster 2024-01-21T07:52:15.108092+0000 mgr.y (mgr.44103) 23 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: cephadm 2024-01-21T07:52:15.125207+0000 mgr.y (mgr.44103) 24 : cephadm [INF] Upgrade: Updating mon.b 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: audit 2024-01-21T07:52:15.133928+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: audit 2024-01-21T07:52:15.135697+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: audit 2024-01-21T07:52:15.137301+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: audit 2024-01-21T07:52:15.139023+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: cephadm 2024-01-21T07:52:15.140461+0000 mgr.y (mgr.44103) 25 : cephadm [INF] Deploying daemon mon.b on smithi195 2024-01-21T07:52:16.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[38631]: audit 2024-01-21T07:52:15.141283+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: cluster 2024-01-21T07:52:15.108092+0000 mgr.y (mgr.44103) 23 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: cephadm 2024-01-21T07:52:15.125207+0000 mgr.y (mgr.44103) 24 : cephadm [INF] Upgrade: Updating mon.b 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: audit 2024-01-21T07:52:15.133928+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: audit 2024-01-21T07:52:15.135697+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: audit 2024-01-21T07:52:15.137301+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: audit 2024-01-21T07:52:15.139023+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: cephadm 2024-01-21T07:52:15.140461+0000 mgr.y (mgr.44103) 25 : cephadm [INF] Deploying daemon mon.b on smithi195 2024-01-21T07:52:16.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:16 smithi080 bash[40414]: audit 2024-01-21T07:52:15.141283+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:16.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:52:16 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:52:17.370 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:17 smithi195 systemd[1]: Stopping Ceph mon.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:52:17.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:17 smithi195 bash[13978]: debug 2024-01-21T07:52:17.367+0000 7fbf0fb11700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:52:17.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:17 smithi195 bash[13978]: debug 2024-01-21T07:52:17.367+0000 7fbf0fb11700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-01-21T07:52:18.513 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:18 smithi195 bash[30734]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.b 2024-01-21T07:52:18.513 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:18 smithi195 bash[30791]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.b 2024-01-21T07:52:18.801 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:18 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.b.service: Succeeded. 2024-01-21T07:52:18.801 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:18 smithi195 systemd[1]: Stopped Ceph mon.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:52:18.801 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:18 smithi195 systemd[1]: Started Ceph mon.b for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:52:19.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.731+0000 7f50f3856880 0 set uid:gid to 167:167 (ceph:ceph) 2024-01-21T07:52:19.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.731+0000 7f50f3856880 0 ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable), process ceph-mon, pid 7 2024-01-21T07:52:19.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.731+0000 7f50f3856880 0 pidfile_write: ignore empty --pid-file 2024-01-21T07:52:19.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 0 load: jerasure load: lrc load: isa 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: RocksDB version: 6.8.1 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Compile date Jan 19 2024 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: DB SUMMARY 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: CURRENT file: CURRENT 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: IDENTITY file: IDENTITY 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 1034 Bytes 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000028.sst 000029.sst 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000026.log size: 28477685 ; 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.error_if_exists: 0 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.create_if_missing: 0 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.paranoid_checks: 1 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.env: 0x561985808080 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.fs: Posix File System 2024-01-21T07:52:19.890 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.info_log: 0x561986ff6220 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_file_opening_threads: 16 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.statistics: (nil) 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.use_fsync: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_log_file_size: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.keep_log_file_num: 1000 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.recycle_log_file_num: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.allow_fallocate: 1 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.allow_mmap_reads: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.allow_mmap_writes: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.use_direct_reads: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.create_missing_column_families: 0 2024-01-21T07:52:19.891 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.db_log_dir: 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_subcompactions: 1 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_background_flushes: -1 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.advise_random_on_open: 1 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.db_write_buffer_size: 0 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.write_buffer_manager: 0x561987cea390 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-21T07:52:19.892 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-21T07:52:19.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-21T07:52:19.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-01-21T07:52:19.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.rate_limiter: (nil) 2024-01-21T07:52:19.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-21T07:52:19.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.wal_recovery_mode: 2 2024-01-21T07:52:19.893 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.enable_thread_tracking: 0 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.enable_pipelined_write: 0 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.unordered_write: 0 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-21T07:52:19.894 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.row_cache: None 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.wal_filter: None 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.allow_ingest_behind: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.preserve_deletes: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.two_write_queues: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.manual_wal_flush: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.atomic_flush: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.log_readahead_size: 0 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_background_jobs: 2 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_background_compactions: -1 2024-01-21T07:52:19.895 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_total_wal_size: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_open_files: -1 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bytes_per_sync: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compaction_readahead_size: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Compression algorithms supported: 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-21T07:52:19.896 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kZSTD supported: 0 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kXpressCompression supported: 0 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kLZ4HCCompression supported: 1 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kLZ4Compression supported: 1 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kBZip2Compression supported: 0 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kZlibCompression supported: 1 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: kSnappyCompression supported: 1 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.merge_operator: 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compaction_filter: None 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compaction_filter_factory: None 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-01-21T07:52:19.897 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561986f99d28) 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: cache_index_and_filter_blocks: 1 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: pin_top_level_index_and_filter: 1 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: index_type: 0 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: data_block_index_type: 0 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: index_shortening: 1 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: data_block_hash_table_util_ratio: 0.750000 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: hash_index_allow_collision: 1 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: checksum: 1 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: no_block_cache: 0 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_cache: 0x561986fd0f10 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_cache_name: BinnedLRUCache 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_cache_options: 2024-01-21T07:52:19.898 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: capacity : 536870912 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: num_shard_bits : 4 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: strict_capacity_limit : 0 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: high_pri_pool_ratio: 0.000 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_cache_compressed: (nil) 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: persistent_cache: (nil) 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_size: 4096 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_size_deviation: 10 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_restart_interval: 16 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: index_block_restart_interval: 1 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: metadata_block_size: 4096 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: partition_filters: 0 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: use_delta_encoding: 1 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: whole_key_filtering: 1 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: verify_compression: 0 2024-01-21T07:52:19.899 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: read_amp_bytes_per_bit: 0 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: format_version: 2 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: enable_index_compression: 1 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: block_align: 0 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.write_buffer_size: 33554432 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_write_buffer_number: 2 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression: NoCompression 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression: Disabled 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.prefix_extractor: nullptr 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.num_levels: 7 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-21T07:52:19.900 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression_opts.level: 32767 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression_opts.strategy: 0 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.compression_opts.enabled: false 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.target_file_size_base: 67108864 2024-01-21T07:52:19.901 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.735+0000 7f50f3856880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.arena_block_size: 4194304 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-21T07:52:19.902 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.disable_auto_compactions: 0 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.table_properties_collectors: 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.inplace_update_support: 0 2024-01-21T07:52:19.903 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.bloom_locality: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.max_successive_merges: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.paranoid_file_checks: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.force_consistency_checks: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.report_bg_io_stats: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.ttl: 2592000 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 31, last_sequence is 11531, log_number is 26,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 26 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823539740979, "job": 1, "event": "recovery_started", "log_files": [26]} 2024-01-21T07:52:19.904 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.739+0000 7f50f3856880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #26 mode 2 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.774+0000 7f50f3856880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.794+0000 7f50f3856880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823539799053, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 31, "file_size": 18733606, "table_properties": {"data_size": 18720766, "index_size": 10672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1349, "raw_key_size": 10753, "raw_average_key_size": 21, "raw_value_size": 18705478, "raw_average_value_size": 36967, "num_data_blocks": 334, "num_entries": 506, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1705823539, "oldest_key_time": 3, "file_creation_time": 0}} 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.798+0000 7f50f3856880 4 rocksdb: [version_set.cc:3826] Creating manifest 32 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.798+0000 7f50f3856880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1705823539800240, "job": 1, "event": "recovery_finished"} 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.802+0000 7f50f3856880 4 rocksdb: DB pointer 0x561987099800 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.802+0000 7f50da648700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.802+0000 7f50da648700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** DB Stats ** 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Uptime(secs): 0.1 total, 0.1 interval 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-21T07:52:19.905 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** Compaction Stats [default] ** 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: L0 1/0 17.87 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: L6 2/0 90.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Sum 3/0 108.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** Compaction Stats [default] ** 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Uptime(secs): 0.1 total, 0.1 interval 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Flush(GB): cumulative 0.017, interval 0.017 2024-01-21T07:52:19.906 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Cumulative compaction: 0.02 GB write, 264.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Interval compaction: 0.02 GB write, 264.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** Compaction Stats [default] ** 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: L0 1/0 17.87 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: L6 2/0 90.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Sum 3/0 108.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** Compaction Stats [default] ** 2024-01-21T07:52:19.907 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 768.8 0.02 0.00 1 0.023 0 0 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Uptime(secs): 0.1 total, 0.0 interval 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Flush(GB): cumulative 0.017, interval 0.000 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(Total Files): cumulative 0, interval 0 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(L0 Files): cumulative 0, interval 0 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: AddFile(Keys): cumulative 0, interval 0 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Cumulative compaction: 0.02 GB write, 264.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: ** File Read Latency Histogram By Level [default] ** 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.806+0000 7f50f3856880 0 starting mon.b rank 2 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.806+0000 7f50f3856880 1 mon.b@-1(???) e3 preinit fsid b86415d2-b82f-11ee-95b0-87774f69a715 2024-01-21T07:52:19.908 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.806+0000 7f50f3856880 0 mon.b@-1(???).mds e1 new map 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.806+0000 7f50f3856880 0 mon.b@-1(???).mds e1 print_map 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: e1 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: enable_multiple, ever_enabled_multiple: 0,0 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: legacy client fscid: -1 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: No filesystems configured 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.806+0000 7f50f3856880 0 mon.b@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.810+0000 7f50f3856880 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.810+0000 7f50f3856880 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.810+0000 7f50f3856880 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: cluster 2024-01-21T07:52:15.108092+0000 mgr.y (mgr.44103) 23 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: cephadm 2024-01-21T07:52:15.125207+0000 mgr.y (mgr.44103) 24 : cephadm [INF] Upgrade: Updating mon.b 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: audit 2024-01-21T07:52:15.133928+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:19.909 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: audit 2024-01-21T07:52:15.135697+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:19.910 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: audit 2024-01-21T07:52:15.137301+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:19.910 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: audit 2024-01-21T07:52:15.139023+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:19.910 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: cephadm 2024-01-21T07:52:15.140461+0000 mgr.y (mgr.44103) 25 : cephadm [INF] Deploying daemon mon.b on smithi195 2024-01-21T07:52:19.910 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: audit 2024-01-21T07:52:15.141283+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:19.910 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:19 smithi195 bash[30911]: debug 2024-01-21T07:52:19.810+0000 7f50f3856880 1 mon.b@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.653583+0000 mon.a (mon.0) 147 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.653598+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.653636+0000 mon.a (mon.0) 148 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.653671+0000 mon.a (mon.0) 149 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.653705+0000 mon.a (mon.0) 150 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: audit 2024-01-21T07:52:20.654628+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.655210+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.655366+0000 mon.a (mon.0) 152 : cluster [INF] mon.a calling monitor election 2024-01-21T07:52:22.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: audit 2024-01-21T07:52:20.657717+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: audit 2024-01-21T07:52:20.658127+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.659131+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.664720+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.665451+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.665515+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.666094+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e36: y(active, since 40s), standbys: x 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.669931+0000 mon.a (mon.0) 160 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.669950+0000 mon.a (mon.0) 161 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.669959+0000 mon.a (mon.0) 162 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: cluster 2024-01-21T07:52:20.670009+0000 mon.a (mon.0) 163 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: audit 2024-01-21T07:52:20.674762+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: audit 2024-01-21T07:52:20.676192+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:22.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[38631]: audit 2024-01-21T07:52:20.678989+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.653583+0000 mon.a (mon.0) 147 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.653598+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.653636+0000 mon.a (mon.0) 148 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.653671+0000 mon.a (mon.0) 149 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.653705+0000 mon.a (mon.0) 150 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: audit 2024-01-21T07:52:20.654628+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.655210+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.655366+0000 mon.a (mon.0) 152 : cluster [INF] mon.a calling monitor election 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: audit 2024-01-21T07:52:20.657717+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: audit 2024-01-21T07:52:20.658127+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.659131+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:52:22.061 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.664720+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.665451+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.665515+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.666094+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e36: y(active, since 40s), standbys: x 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.669931+0000 mon.a (mon.0) 160 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.669950+0000 mon.a (mon.0) 161 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.669959+0000 mon.a (mon.0) 162 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: cluster 2024-01-21T07:52:20.670009+0000 mon.a (mon.0) 163 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: audit 2024-01-21T07:52:20.674762+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: audit 2024-01-21T07:52:20.676192+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:22.062 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:21 smithi080 bash[40414]: audit 2024-01-21T07:52:20.678989+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:52:22.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.653583+0000 mon.a (mon.0) 147 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:22.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.653598+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.653636+0000 mon.a (mon.0) 148 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.653671+0000 mon.a (mon.0) 149 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.653705+0000 mon.a (mon.0) 150 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: audit 2024-01-21T07:52:20.654628+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.655210+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.655366+0000 mon.a (mon.0) 152 : cluster [INF] mon.a calling monitor election 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: audit 2024-01-21T07:52:20.657717+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: audit 2024-01-21T07:52:20.658127+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.659131+0000 mon.a (mon.0) 155 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.664720+0000 mon.a (mon.0) 156 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.665451+0000 mon.a (mon.0) 157 : cluster [DBG] fsmap 2024-01-21T07:52:22.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.665515+0000 mon.a (mon.0) 158 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.666094+0000 mon.a (mon.0) 159 : cluster [DBG] mgrmap e36: y(active, since 40s), standbys: x 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.669931+0000 mon.a (mon.0) 160 : cluster [WRN] Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.669950+0000 mon.a (mon.0) 161 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.669959+0000 mon.a (mon.0) 162 : cluster [WRN] daemon node-exporter.a on smithi080 is in error state 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: cluster 2024-01-21T07:52:20.670009+0000 mon.a (mon.0) 163 : cluster [WRN] daemon node-exporter.b on smithi195 is in error state 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: audit 2024-01-21T07:52:20.674762+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: audit 2024-01-21T07:52:20.676192+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:22.141 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:21 smithi195 bash[30911]: audit 2024-01-21T07:52:20.678989+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:52:23.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:22 smithi080 bash[38631]: cluster 2024-01-21T07:52:21.111091+0000 mgr.y (mgr.44103) 28 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:23.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:22 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:22] "GET /metrics HTTP/1.1" 200 149423 "" "Prometheus/2.33.4" 2024-01-21T07:52:23.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:22 smithi080 bash[40414]: cluster 2024-01-21T07:52:21.111091+0000 mgr.y (mgr.44103) 28 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:23.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:22 smithi195 bash[30911]: cluster 2024-01-21T07:52:21.111091+0000 mgr.y (mgr.44103) 28 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:25.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:24 smithi080 bash[38631]: cluster 2024-01-21T07:52:23.112572+0000 mgr.y (mgr.44103) 29 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:25.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:24 smithi080 bash[40414]: cluster 2024-01-21T07:52:23.112572+0000 mgr.y (mgr.44103) 29 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:25.059 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:24 smithi080 bash[36925]: debug 2024-01-21T07:52:24.819+0000 7faad1343700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-21T07:52:25.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:24 smithi195 bash[30911]: cluster 2024-01-21T07:52:23.112572+0000 mgr.y (mgr.44103) 29 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:27.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:52:26 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:52:27.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:26 smithi195 bash[30911]: cluster 2024-01-21T07:52:25.113295+0000 mgr.y (mgr.44103) 30 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:27.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:26 smithi195 bash[30911]: audit 2024-01-21T07:52:26.807023+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:27.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:26 smithi195 bash[30911]: audit 2024-01-21T07:52:26.818167+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:27.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:26 smithi195 bash[30911]: audit 2024-01-21T07:52:26.823211+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[38631]: cluster 2024-01-21T07:52:25.113295+0000 mgr.y (mgr.44103) 30 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:27.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[38631]: audit 2024-01-21T07:52:26.807023+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:27.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[38631]: audit 2024-01-21T07:52:26.818167+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:27.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[38631]: audit 2024-01-21T07:52:26.823211+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[40414]: cluster 2024-01-21T07:52:25.113295+0000 mgr.y (mgr.44103) 30 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[40414]: audit 2024-01-21T07:52:26.807023+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[40414]: audit 2024-01-21T07:52:26.818167+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:27.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:26 smithi080 bash[40414]: audit 2024-01-21T07:52:26.823211+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:28.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: cluster 2024-01-21T07:52:26.810243+0000 mgr.y (mgr.44103) 31 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:28.121 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: cluster 2024-01-21T07:52:26.810761+0000 mgr.y (mgr.44103) 32 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: cephadm 2024-01-21T07:52:26.822807+0000 mgr.y (mgr.44103) 33 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: audit 2024-01-21T07:52:26.824243+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: audit 2024-01-21T07:52:26.826108+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: cephadm 2024-01-21T07:52:26.827889+0000 mgr.y (mgr.44103) 34 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[38631]: audit 2024-01-21T07:52:26.832332+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: cluster 2024-01-21T07:52:26.810243+0000 mgr.y (mgr.44103) 31 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: cluster 2024-01-21T07:52:26.810761+0000 mgr.y (mgr.44103) 32 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: cephadm 2024-01-21T07:52:26.822807+0000 mgr.y (mgr.44103) 33 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: audit 2024-01-21T07:52:26.824243+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:28.122 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: audit 2024-01-21T07:52:26.826108+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:28.123 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: cephadm 2024-01-21T07:52:26.827889+0000 mgr.y (mgr.44103) 34 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-01-21T07:52:28.123 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:27 smithi080 bash[40414]: audit 2024-01-21T07:52:26.832332+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: cluster 2024-01-21T07:52:26.810243+0000 mgr.y (mgr.44103) 31 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: cluster 2024-01-21T07:52:26.810761+0000 mgr.y (mgr.44103) 32 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: cephadm 2024-01-21T07:52:26.822807+0000 mgr.y (mgr.44103) 33 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: audit 2024-01-21T07:52:26.824243+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: audit 2024-01-21T07:52:26.826108+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: cephadm 2024-01-21T07:52:26.827889+0000 mgr.y (mgr.44103) 34 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-01-21T07:52:28.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:27 smithi195 bash[30911]: audit 2024-01-21T07:52:26.832332+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: cluster 2024-01-21T07:52:28.811546+0000 mgr.y (mgr.44103) 35 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: audit 2024-01-21T07:52:28.840483+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: cephadm 2024-01-21T07:52:28.841767+0000 mgr.y (mgr.44103) 36 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: audit 2024-01-21T07:52:28.842377+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: audit 2024-01-21T07:52:28.844006+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: audit 2024-01-21T07:52:28.845752+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: cephadm 2024-01-21T07:52:28.847093+0000 mgr.y (mgr.44103) 37 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-01-21T07:52:30.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:29 smithi195 bash[30911]: audit 2024-01-21T07:52:28.848018+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: cluster 2024-01-21T07:52:28.811546+0000 mgr.y (mgr.44103) 35 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: audit 2024-01-21T07:52:28.840483+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: cephadm 2024-01-21T07:52:28.841767+0000 mgr.y (mgr.44103) 36 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: audit 2024-01-21T07:52:28.842377+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: audit 2024-01-21T07:52:28.844006+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: audit 2024-01-21T07:52:28.845752+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:30.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: cephadm 2024-01-21T07:52:28.847093+0000 mgr.y (mgr.44103) 37 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[38631]: audit 2024-01-21T07:52:28.848018+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: cluster 2024-01-21T07:52:28.811546+0000 mgr.y (mgr.44103) 35 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: audit 2024-01-21T07:52:28.840483+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: cephadm 2024-01-21T07:52:28.841767+0000 mgr.y (mgr.44103) 36 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: audit 2024-01-21T07:52:28.842377+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: audit 2024-01-21T07:52:28.844006+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: audit 2024-01-21T07:52:28.845752+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: cephadm 2024-01-21T07:52:28.847093+0000 mgr.y (mgr.44103) 37 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-01-21T07:52:30.168 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:29 smithi080 bash[40414]: audit 2024-01-21T07:52:28.848018+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-01-21T07:52:31.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: audit 2024-01-21T07:52:30.760267+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:31.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: cephadm 2024-01-21T07:52:30.761700+0000 mgr.y (mgr.44103) 38 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-01-21T07:52:31.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: audit 2024-01-21T07:52:30.763146+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:31.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: audit 2024-01-21T07:52:30.764627+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:31.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: audit 2024-01-21T07:52:30.766221+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: cephadm 2024-01-21T07:52:30.767479+0000 mgr.y (mgr.44103) 39 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: audit 2024-01-21T07:52:30.768277+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[38631]: cluster 2024-01-21T07:52:30.812376+0000 mgr.y (mgr.44103) 40 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: audit 2024-01-21T07:52:30.760267+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: cephadm 2024-01-21T07:52:30.761700+0000 mgr.y (mgr.44103) 38 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: audit 2024-01-21T07:52:30.763146+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: audit 2024-01-21T07:52:30.764627+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: audit 2024-01-21T07:52:30.766221+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: cephadm 2024-01-21T07:52:30.767479+0000 mgr.y (mgr.44103) 39 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: audit 2024-01-21T07:52:30.768277+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:52:31.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:31 smithi080 bash[40414]: cluster 2024-01-21T07:52:30.812376+0000 mgr.y (mgr.44103) 40 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: audit 2024-01-21T07:52:30.760267+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: cephadm 2024-01-21T07:52:30.761700+0000 mgr.y (mgr.44103) 38 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: audit 2024-01-21T07:52:30.763146+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: audit 2024-01-21T07:52:30.764627+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: audit 2024-01-21T07:52:30.766221+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: cephadm 2024-01-21T07:52:30.767479+0000 mgr.y (mgr.44103) 39 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-01-21T07:52:32.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: audit 2024-01-21T07:52:30.768277+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-01-21T07:52:32.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:31 smithi195 bash[30911]: cluster 2024-01-21T07:52:30.812376+0000 mgr.y (mgr.44103) 40 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:33.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:32 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:32] "GET /metrics HTTP/1.1" 200 146464 "" "Prometheus/2.33.4" 2024-01-21T07:52:33.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: audit 2024-01-21T07:52:32.538291+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: cephadm 2024-01-21T07:52:32.539889+0000 mgr.y (mgr.44103) 41 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: audit 2024-01-21T07:52:32.540503+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: audit 2024-01-21T07:52:32.542160+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: cephadm 2024-01-21T07:52:32.544373+0000 mgr.y (mgr.44103) 42 : cephadm [INF] Reconfiguring daemon osd.0 on smithi080 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: audit 2024-01-21T07:52:32.545030+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[38631]: cluster 2024-01-21T07:52:32.813829+0000 mgr.y (mgr.44103) 43 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: audit 2024-01-21T07:52:32.538291+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: cephadm 2024-01-21T07:52:32.539889+0000 mgr.y (mgr.44103) 41 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: audit 2024-01-21T07:52:32.540503+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: audit 2024-01-21T07:52:32.542160+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:33.809 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: cephadm 2024-01-21T07:52:32.544373+0000 mgr.y (mgr.44103) 42 : cephadm [INF] Reconfiguring daemon osd.0 on smithi080 2024-01-21T07:52:33.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: audit 2024-01-21T07:52:32.545030+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-01-21T07:52:33.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:33 smithi080 bash[40414]: cluster 2024-01-21T07:52:32.813829+0000 mgr.y (mgr.44103) 43 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: audit 2024-01-21T07:52:32.538291+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: cephadm 2024-01-21T07:52:32.539889+0000 mgr.y (mgr.44103) 41 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: audit 2024-01-21T07:52:32.540503+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: audit 2024-01-21T07:52:32.542160+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: cephadm 2024-01-21T07:52:32.544373+0000 mgr.y (mgr.44103) 42 : cephadm [INF] Reconfiguring daemon osd.0 on smithi080 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: audit 2024-01-21T07:52:32.545030+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-01-21T07:52:33.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:33 smithi195 bash[30911]: cluster 2024-01-21T07:52:32.813829+0000 mgr.y (mgr.44103) 43 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: audit 2024-01-21T07:52:34.586793+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: cephadm 2024-01-21T07:52:34.588372+0000 mgr.y (mgr.44103) 44 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: audit 2024-01-21T07:52:34.588847+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: audit 2024-01-21T07:52:34.590357+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: cephadm 2024-01-21T07:52:34.592678+0000 mgr.y (mgr.44103) 45 : cephadm [INF] Reconfiguring daemon osd.1 on smithi080 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: audit 2024-01-21T07:52:34.593460+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-01-21T07:52:35.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:35 smithi195 bash[30911]: cluster 2024-01-21T07:52:34.814537+0000 mgr.y (mgr.44103) 46 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:35.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: audit 2024-01-21T07:52:34.586793+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:35.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: cephadm 2024-01-21T07:52:34.588372+0000 mgr.y (mgr.44103) 44 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-01-21T07:52:35.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: audit 2024-01-21T07:52:34.588847+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: audit 2024-01-21T07:52:34.590357+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: cephadm 2024-01-21T07:52:34.592678+0000 mgr.y (mgr.44103) 45 : cephadm [INF] Reconfiguring daemon osd.1 on smithi080 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: audit 2024-01-21T07:52:34.593460+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[38631]: cluster 2024-01-21T07:52:34.814537+0000 mgr.y (mgr.44103) 46 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: audit 2024-01-21T07:52:34.586793+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: cephadm 2024-01-21T07:52:34.588372+0000 mgr.y (mgr.44103) 44 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: audit 2024-01-21T07:52:34.588847+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: audit 2024-01-21T07:52:34.590357+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: cephadm 2024-01-21T07:52:34.592678+0000 mgr.y (mgr.44103) 45 : cephadm [INF] Reconfiguring daemon osd.1 on smithi080 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: audit 2024-01-21T07:52:34.593460+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-01-21T07:52:35.917 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:35 smithi080 bash[40414]: cluster 2024-01-21T07:52:34.814537+0000 mgr.y (mgr.44103) 46 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:37.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:52:36 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:52:37.790 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: audit 2024-01-21T07:52:36.461928+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: cephadm 2024-01-21T07:52:36.463412+0000 mgr.y (mgr.44103) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: audit 2024-01-21T07:52:36.463859+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: audit 2024-01-21T07:52:36.465156+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: cephadm 2024-01-21T07:52:36.466904+0000 mgr.y (mgr.44103) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi080 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: audit 2024-01-21T07:52:36.467556+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[40414]: cluster 2024-01-21T07:52:36.816091+0000 mgr.y (mgr.44103) 49 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: audit 2024-01-21T07:52:36.461928+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: cephadm 2024-01-21T07:52:36.463412+0000 mgr.y (mgr.44103) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: audit 2024-01-21T07:52:36.463859+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: audit 2024-01-21T07:52:36.465156+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:37.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: cephadm 2024-01-21T07:52:36.466904+0000 mgr.y (mgr.44103) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi080 2024-01-21T07:52:37.792 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: audit 2024-01-21T07:52:36.467556+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-01-21T07:52:37.792 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:37 smithi080 bash[38631]: cluster 2024-01-21T07:52:36.816091+0000 mgr.y (mgr.44103) 49 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: audit 2024-01-21T07:52:36.461928+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: cephadm 2024-01-21T07:52:36.463412+0000 mgr.y (mgr.44103) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: audit 2024-01-21T07:52:36.463859+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: audit 2024-01-21T07:52:36.465156+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: cephadm 2024-01-21T07:52:36.466904+0000 mgr.y (mgr.44103) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi080 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: audit 2024-01-21T07:52:36.467556+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-01-21T07:52:37.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:37 smithi195 bash[30911]: cluster 2024-01-21T07:52:36.816091+0000 mgr.y (mgr.44103) 49 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: audit 2024-01-21T07:52:38.320914+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: cephadm 2024-01-21T07:52:38.322670+0000 mgr.y (mgr.44103) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: audit 2024-01-21T07:52:38.323270+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: audit 2024-01-21T07:52:38.324861+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: cephadm 2024-01-21T07:52:38.327481+0000 mgr.y (mgr.44103) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi080 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: audit 2024-01-21T07:52:38.328182+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-01-21T07:52:39.615 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[40414]: cluster 2024-01-21T07:52:38.816833+0000 mgr.y (mgr.44103) 52 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: audit 2024-01-21T07:52:38.320914+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: cephadm 2024-01-21T07:52:38.322670+0000 mgr.y (mgr.44103) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: audit 2024-01-21T07:52:38.323270+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: audit 2024-01-21T07:52:38.324861+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: cephadm 2024-01-21T07:52:38.327481+0000 mgr.y (mgr.44103) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi080 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: audit 2024-01-21T07:52:38.328182+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-01-21T07:52:39.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:39 smithi080 bash[38631]: cluster 2024-01-21T07:52:38.816833+0000 mgr.y (mgr.44103) 52 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: audit 2024-01-21T07:52:38.320914+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: cephadm 2024-01-21T07:52:38.322670+0000 mgr.y (mgr.44103) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: audit 2024-01-21T07:52:38.323270+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: audit 2024-01-21T07:52:38.324861+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: cephadm 2024-01-21T07:52:38.327481+0000 mgr.y (mgr.44103) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi080 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: audit 2024-01-21T07:52:38.328182+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-01-21T07:52:39.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:39 smithi195 bash[30911]: cluster 2024-01-21T07:52:38.816833+0000 mgr.y (mgr.44103) 52 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:41.548 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.183321+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:41.548 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: cephadm 2024-01-21T07:52:40.184668+0000 mgr.y (mgr.44103) 53 : cephadm [INF] Reconfiguring rgw.r.z.smithi080.bytdbv (monmap changed)... 2024-01-21T07:52:41.548 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.185147+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:41.548 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.186753+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:41.548 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.192260+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: cephadm 2024-01-21T07:52:40.193223+0000 mgr.y (mgr.44103) 54 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi080.bytdbv 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.201666+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.203149+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi080.bytdbv"}]: dispatch 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.204365+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: cephadm 2024-01-21T07:52:40.205573+0000 mgr.y (mgr.44103) 55 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi080.bytdbv on smithi080 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: audit 2024-01-21T07:52:40.206520+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.bytdbv","key": "container_image"}]: dispatch 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[38631]: cluster 2024-01-21T07:52:40.817573+0000 mgr.y (mgr.44103) 56 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.183321+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: cephadm 2024-01-21T07:52:40.184668+0000 mgr.y (mgr.44103) 53 : cephadm [INF] Reconfiguring rgw.r.z.smithi080.bytdbv (monmap changed)... 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.185147+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:41.549 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.186753+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.192260+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: cephadm 2024-01-21T07:52:40.193223+0000 mgr.y (mgr.44103) 54 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi080.bytdbv 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.201666+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.203149+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi080.bytdbv"}]: dispatch 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.204365+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: cephadm 2024-01-21T07:52:40.205573+0000 mgr.y (mgr.44103) 55 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi080.bytdbv on smithi080 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: audit 2024-01-21T07:52:40.206520+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.bytdbv","key": "container_image"}]: dispatch 2024-01-21T07:52:41.550 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:41 smithi080 bash[40414]: cluster 2024-01-21T07:52:40.817573+0000 mgr.y (mgr.44103) 56 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:41.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.183321+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:41.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: cephadm 2024-01-21T07:52:40.184668+0000 mgr.y (mgr.44103) 53 : cephadm [INF] Reconfiguring rgw.r.z.smithi080.bytdbv (monmap changed)... 2024-01-21T07:52:41.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.185147+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:41.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.186753+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:41.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.192260+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.bytdbv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-01-21T07:52:41.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: cephadm 2024-01-21T07:52:40.193223+0000 mgr.y (mgr.44103) 54 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi080.bytdbv 2024-01-21T07:52:41.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.201666+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:41.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.203149+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi080.bytdbv"}]: dispatch 2024-01-21T07:52:41.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.204365+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:41.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: cephadm 2024-01-21T07:52:40.205573+0000 mgr.y (mgr.44103) 55 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi080.bytdbv on smithi080 2024-01-21T07:52:41.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: audit 2024-01-21T07:52:40.206520+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.bytdbv","key": "container_image"}]: dispatch 2024-01-21T07:52:41.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:41 smithi195 bash[30911]: cluster 2024-01-21T07:52:40.817573+0000 mgr.y (mgr.44103) 56 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:43.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:42 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:42] "GET /metrics HTTP/1.1" 200 146464 "" "Prometheus/2.33.4" 2024-01-21T07:52:43.360 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: audit 2024-01-21T07:52:42.101839+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:43.360 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: cephadm 2024-01-21T07:52:42.103957+0000 mgr.y (mgr.44103) 57 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-01-21T07:52:43.360 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: audit 2024-01-21T07:52:42.104547+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:43.361 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: audit 2024-01-21T07:52:42.106132+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:43.361 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: audit 2024-01-21T07:52:42.107487+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:43.361 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: cephadm 2024-01-21T07:52:42.108558+0000 mgr.y (mgr.44103) 58 : cephadm [INF] Reconfiguring daemon mon.b on smithi195 2024-01-21T07:52:43.361 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: audit 2024-01-21T07:52:42.109274+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:43.361 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:43 smithi195 bash[30911]: cluster 2024-01-21T07:52:42.819042+0000 mgr.y (mgr.44103) 59 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: audit 2024-01-21T07:52:42.101839+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: cephadm 2024-01-21T07:52:42.103957+0000 mgr.y (mgr.44103) 57 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: audit 2024-01-21T07:52:42.104547+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: audit 2024-01-21T07:52:42.106132+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: audit 2024-01-21T07:52:42.107487+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: cephadm 2024-01-21T07:52:42.108558+0000 mgr.y (mgr.44103) 58 : cephadm [INF] Reconfiguring daemon mon.b on smithi195 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: audit 2024-01-21T07:52:42.109274+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[38631]: cluster 2024-01-21T07:52:42.819042+0000 mgr.y (mgr.44103) 59 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:43.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: audit 2024-01-21T07:52:42.101839+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: cephadm 2024-01-21T07:52:42.103957+0000 mgr.y (mgr.44103) 57 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: audit 2024-01-21T07:52:42.104547+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: audit 2024-01-21T07:52:42.106132+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: audit 2024-01-21T07:52:42.107487+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: cephadm 2024-01-21T07:52:42.108558+0000 mgr.y (mgr.44103) 58 : cephadm [INF] Reconfiguring daemon mon.b on smithi195 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: audit 2024-01-21T07:52:42.109274+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-01-21T07:52:43.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:43 smithi080 bash[40414]: cluster 2024-01-21T07:52:42.819042+0000 mgr.y (mgr.44103) 59 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: audit 2024-01-21T07:52:44.317499+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: cephadm 2024-01-21T07:52:44.319284+0000 mgr.y (mgr.44103) 60 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: audit 2024-01-21T07:52:44.319801+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: audit 2024-01-21T07:52:44.321397+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: audit 2024-01-21T07:52:44.322503+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: cephadm 2024-01-21T07:52:44.323596+0000 mgr.y (mgr.44103) 61 : cephadm [INF] Reconfiguring daemon mgr.x on smithi195 2024-01-21T07:52:45.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: audit 2024-01-21T07:52:44.324234+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-01-21T07:52:45.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:45 smithi195 bash[30911]: cluster 2024-01-21T07:52:44.819753+0000 mgr.y (mgr.44103) 62 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:45.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: audit 2024-01-21T07:52:44.317499+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:45.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: cephadm 2024-01-21T07:52:44.319284+0000 mgr.y (mgr.44103) 60 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-01-21T07:52:45.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: audit 2024-01-21T07:52:44.319801+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: audit 2024-01-21T07:52:44.321397+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: audit 2024-01-21T07:52:44.322503+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: cephadm 2024-01-21T07:52:44.323596+0000 mgr.y (mgr.44103) 61 : cephadm [INF] Reconfiguring daemon mgr.x on smithi195 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: audit 2024-01-21T07:52:44.324234+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[38631]: cluster 2024-01-21T07:52:44.819753+0000 mgr.y (mgr.44103) 62 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: audit 2024-01-21T07:52:44.317499+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: cephadm 2024-01-21T07:52:44.319284+0000 mgr.y (mgr.44103) 60 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: audit 2024-01-21T07:52:44.319801+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: audit 2024-01-21T07:52:44.321397+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: audit 2024-01-21T07:52:44.322503+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:45.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: cephadm 2024-01-21T07:52:44.323596+0000 mgr.y (mgr.44103) 61 : cephadm [INF] Reconfiguring daemon mgr.x on smithi195 2024-01-21T07:52:45.812 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: audit 2024-01-21T07:52:44.324234+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-01-21T07:52:45.812 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:45 smithi080 bash[40414]: cluster 2024-01-21T07:52:44.819753+0000 mgr.y (mgr.44103) 62 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:46.889 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:52:46 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:46] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.317826+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: cephadm 2024-01-21T07:52:46.319727+0000 mgr.y (mgr.44103) 63 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.320467+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.322438+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: cephadm 2024-01-21T07:52:46.325661+0000 mgr.y (mgr.44103) 64 : cephadm [INF] Reconfiguring daemon osd.4 on smithi195 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.326793+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.549667+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-01-21T07:52:47.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.550649+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-01-21T07:52:47.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.550982+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-01-21T07:52:47.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: audit 2024-01-21T07:52:46.551294+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-01-21T07:52:47.640 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:47 smithi195 bash[30911]: cluster 2024-01-21T07:52:46.820753+0000 mgr.y (mgr.44103) 65 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.317826+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: cephadm 2024-01-21T07:52:46.319727+0000 mgr.y (mgr.44103) 63 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.320467+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.322438+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: cephadm 2024-01-21T07:52:46.325661+0000 mgr.y (mgr.44103) 64 : cephadm [INF] Reconfiguring daemon osd.4 on smithi195 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.326793+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.549667+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.550649+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.550982+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: audit 2024-01-21T07:52:46.551294+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-01-21T07:52:47.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[38631]: cluster 2024-01-21T07:52:46.820753+0000 mgr.y (mgr.44103) 65 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.317826+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: cephadm 2024-01-21T07:52:46.319727+0000 mgr.y (mgr.44103) 63 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.320467+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.322438+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: cephadm 2024-01-21T07:52:46.325661+0000 mgr.y (mgr.44103) 64 : cephadm [INF] Reconfiguring daemon osd.4 on smithi195 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.326793+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.549667+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.550649+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.550982+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: audit 2024-01-21T07:52:46.551294+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-01-21T07:52:47.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:47 smithi080 bash[40414]: cluster 2024-01-21T07:52:46.820753+0000 mgr.y (mgr.44103) 65 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: audit 2024-01-21T07:52:48.315658+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: cephadm 2024-01-21T07:52:48.317332+0000 mgr.y (mgr.44103) 66 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: audit 2024-01-21T07:52:48.317891+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: audit 2024-01-21T07:52:48.319479+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: cephadm 2024-01-21T07:52:48.322471+0000 mgr.y (mgr.44103) 67 : cephadm [INF] Reconfiguring daemon osd.5 on smithi195 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: audit 2024-01-21T07:52:48.323506+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-01-21T07:52:49.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:49 smithi195 bash[30911]: cluster 2024-01-21T07:52:48.821436+0000 mgr.y (mgr.44103) 68 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: audit 2024-01-21T07:52:48.315658+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: cephadm 2024-01-21T07:52:48.317332+0000 mgr.y (mgr.44103) 66 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: audit 2024-01-21T07:52:48.317891+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: audit 2024-01-21T07:52:48.319479+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: cephadm 2024-01-21T07:52:48.322471+0000 mgr.y (mgr.44103) 67 : cephadm [INF] Reconfiguring daemon osd.5 on smithi195 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: audit 2024-01-21T07:52:48.323506+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-01-21T07:52:49.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[38631]: cluster 2024-01-21T07:52:48.821436+0000 mgr.y (mgr.44103) 68 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: audit 2024-01-21T07:52:48.315658+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: cephadm 2024-01-21T07:52:48.317332+0000 mgr.y (mgr.44103) 66 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: audit 2024-01-21T07:52:48.317891+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: audit 2024-01-21T07:52:48.319479+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: cephadm 2024-01-21T07:52:48.322471+0000 mgr.y (mgr.44103) 67 : cephadm [INF] Reconfiguring daemon osd.5 on smithi195 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: audit 2024-01-21T07:52:48.323506+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-01-21T07:52:49.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:49 smithi080 bash[40414]: cluster 2024-01-21T07:52:48.821436+0000 mgr.y (mgr.44103) 68 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:51.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: audit 2024-01-21T07:52:50.256371+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: cephadm 2024-01-21T07:52:50.257705+0000 mgr.y (mgr.44103) 69 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: audit 2024-01-21T07:52:50.258189+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: audit 2024-01-21T07:52:50.259625+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: cephadm 2024-01-21T07:52:50.261452+0000 mgr.y (mgr.44103) 70 : cephadm [INF] Reconfiguring daemon osd.6 on smithi195 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: audit 2024-01-21T07:52:50.262195+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[38631]: cluster 2024-01-21T07:52:50.822163+0000 mgr.y (mgr.44103) 71 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: audit 2024-01-21T07:52:50.256371+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: cephadm 2024-01-21T07:52:50.257705+0000 mgr.y (mgr.44103) 69 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: audit 2024-01-21T07:52:50.258189+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: audit 2024-01-21T07:52:50.259625+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: cephadm 2024-01-21T07:52:50.261452+0000 mgr.y (mgr.44103) 70 : cephadm [INF] Reconfiguring daemon osd.6 on smithi195 2024-01-21T07:52:51.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: audit 2024-01-21T07:52:50.262195+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-01-21T07:52:51.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:51 smithi080 bash[40414]: cluster 2024-01-21T07:52:50.822163+0000 mgr.y (mgr.44103) 71 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: audit 2024-01-21T07:52:50.256371+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: cephadm 2024-01-21T07:52:50.257705+0000 mgr.y (mgr.44103) 69 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: audit 2024-01-21T07:52:50.258189+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: audit 2024-01-21T07:52:50.259625+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: cephadm 2024-01-21T07:52:50.261452+0000 mgr.y (mgr.44103) 70 : cephadm [INF] Reconfiguring daemon osd.6 on smithi195 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: audit 2024-01-21T07:52:50.262195+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-01-21T07:52:51.639 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:51 smithi195 bash[30911]: cluster 2024-01-21T07:52:50.822163+0000 mgr.y (mgr.44103) 71 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:53.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:52:52 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:52] "GET /metrics HTTP/1.1" 200 146479 "" "Prometheus/2.33.4" 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: audit 2024-01-21T07:52:52.203060+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: cephadm 2024-01-21T07:52:52.204609+0000 mgr.y (mgr.44103) 72 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: audit 2024-01-21T07:52:52.205122+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: audit 2024-01-21T07:52:52.206795+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: cephadm 2024-01-21T07:52:52.209216+0000 mgr.y (mgr.44103) 73 : cephadm [INF] Reconfiguring daemon osd.7 on smithi195 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: audit 2024-01-21T07:52:52.209916+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-01-21T07:52:53.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[38631]: cluster 2024-01-21T07:52:52.823662+0000 mgr.y (mgr.44103) 74 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: audit 2024-01-21T07:52:52.203060+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: cephadm 2024-01-21T07:52:52.204609+0000 mgr.y (mgr.44103) 72 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: audit 2024-01-21T07:52:52.205122+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: audit 2024-01-21T07:52:52.206795+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: cephadm 2024-01-21T07:52:52.209216+0000 mgr.y (mgr.44103) 73 : cephadm [INF] Reconfiguring daemon osd.7 on smithi195 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: audit 2024-01-21T07:52:52.209916+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-01-21T07:52:53.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:53 smithi080 bash[40414]: cluster 2024-01-21T07:52:52.823662+0000 mgr.y (mgr.44103) 74 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: audit 2024-01-21T07:52:52.203060+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: cephadm 2024-01-21T07:52:52.204609+0000 mgr.y (mgr.44103) 72 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: audit 2024-01-21T07:52:52.205122+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: audit 2024-01-21T07:52:52.206795+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: cephadm 2024-01-21T07:52:52.209216+0000 mgr.y (mgr.44103) 73 : cephadm [INF] Reconfiguring daemon osd.7 on smithi195 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: audit 2024-01-21T07:52:52.209916+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-01-21T07:52:53.586 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:53 smithi195 bash[30911]: cluster 2024-01-21T07:52:52.823662+0000 mgr.y (mgr.44103) 74 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.076928+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: cephadm 2024-01-21T07:52:54.079451+0000 mgr.y (mgr.44103) 75 : cephadm [INF] Reconfiguring rgw.r.z.smithi195.uawmcm (monmap changed)... 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.080118+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.081930+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.088785+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: cephadm 2024-01-21T07:52:54.089942+0000 mgr.y (mgr.44103) 76 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi195.uawmcm 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.095833+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:55.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.097372+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi195.uawmcm"}]: dispatch 2024-01-21T07:52:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.098932+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:55.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:55 smithi195 bash[30911]: audit 2024-01-21T07:52:54.101034+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi195.uawmcm","key": "container_image"}]: dispatch 2024-01-21T07:52:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.076928+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: cephadm 2024-01-21T07:52:54.079451+0000 mgr.y (mgr.44103) 75 : cephadm [INF] Reconfiguring rgw.r.z.smithi195.uawmcm (monmap changed)... 2024-01-21T07:52:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.080118+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.081930+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:55.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.088785+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: cephadm 2024-01-21T07:52:54.089942+0000 mgr.y (mgr.44103) 76 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi195.uawmcm 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.095833+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.097372+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi195.uawmcm"}]: dispatch 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.098932+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[38631]: audit 2024-01-21T07:52:54.101034+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi195.uawmcm","key": "container_image"}]: dispatch 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.076928+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: cephadm 2024-01-21T07:52:54.079451+0000 mgr.y (mgr.44103) 75 : cephadm [INF] Reconfiguring rgw.r.z.smithi195.uawmcm (monmap changed)... 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.080118+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:55.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.081930+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-01-21T07:52:55.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.088785+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi195.uawmcm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-01-21T07:52:55.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: cephadm 2024-01-21T07:52:54.089942+0000 mgr.y (mgr.44103) 76 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi195.uawmcm 2024-01-21T07:52:55.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.095833+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:55.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.097372+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi195.uawmcm"}]: dispatch 2024-01-21T07:52:55.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.098932+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:55.561 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:55 smithi080 bash[40414]: audit 2024-01-21T07:52:54.101034+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi195.uawmcm","key": "container_image"}]: dispatch 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: cephadm 2024-01-21T07:52:54.100154+0000 mgr.y (mgr.44103) 77 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi195.uawmcm on smithi195 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: cluster 2024-01-21T07:52:54.824327+0000 mgr.y (mgr.44103) 78 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:55.978955+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:55.983752+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:55.989143+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:55.992555+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.001532+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.003034+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.008404+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.009674+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.015180+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.016504+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.022089+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.023959+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.032921+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[30911]: audit 2024-01-21T07:52:56.035689+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-21T07:52:56.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: cephadm 2024-01-21T07:52:54.100154+0000 mgr.y (mgr.44103) 77 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi195.uawmcm on smithi195 2024-01-21T07:52:56.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: cluster 2024-01-21T07:52:54.824327+0000 mgr.y (mgr.44103) 78 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:55.978955+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:55.983752+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:55.989143+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:55.992555+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.001532+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.003034+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.008404+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.009674+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.015180+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.016504+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.022089+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.023959+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.032921+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[38631]: audit 2024-01-21T07:52:56.035689+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: cephadm 2024-01-21T07:52:54.100154+0000 mgr.y (mgr.44103) 77 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi195.uawmcm on smithi195 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: cluster 2024-01-21T07:52:54.824327+0000 mgr.y (mgr.44103) 78 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:55.978955+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:55.983752+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:55.989143+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:55.992555+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.001532+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.003034+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.008404+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-01-21T07:52:56.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.009674+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-01-21T07:52:56.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.015180+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-01-21T07:52:56.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.016504+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-01-21T07:52:56.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.022089+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-01-21T07:52:56.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.023959+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:52:56.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.032921+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:56.565 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:56 smithi080 bash[40414]: audit 2024-01-21T07:52:56.035689+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-21T07:52:57.109 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:52:56 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:52:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:52:57.109 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:57 smithi195 bash[30911]: cephadm 2024-01-21T07:52:55.994085+0000 mgr.y (mgr.44103) 79 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-01-21T07:52:57.109 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:57 smithi195 bash[30911]: cephadm 2024-01-21T07:52:56.025061+0000 mgr.y (mgr.44103) 80 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-01-21T07:52:57.109 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:57 smithi195 bash[30911]: audit 2024-01-21T07:52:56.036045+0000 mgr.y (mgr.44103) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-21T07:52:57.109 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:57 smithi195 bash[30911]: cephadm 2024-01-21T07:52:56.037974+0000 mgr.y (mgr.44103) 82 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-01-21T07:52:57.461 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[38631]: cephadm 2024-01-21T07:52:55.994085+0000 mgr.y (mgr.44103) 79 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-01-21T07:52:57.461 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[38631]: cephadm 2024-01-21T07:52:56.025061+0000 mgr.y (mgr.44103) 80 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-01-21T07:52:57.461 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[38631]: audit 2024-01-21T07:52:56.036045+0000 mgr.y (mgr.44103) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-21T07:52:57.461 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[38631]: cephadm 2024-01-21T07:52:56.037974+0000 mgr.y (mgr.44103) 82 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-01-21T07:52:57.461 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[40414]: cephadm 2024-01-21T07:52:55.994085+0000 mgr.y (mgr.44103) 79 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-01-21T07:52:57.462 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[40414]: cephadm 2024-01-21T07:52:56.025061+0000 mgr.y (mgr.44103) 80 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-01-21T07:52:57.462 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[40414]: audit 2024-01-21T07:52:56.036045+0000 mgr.y (mgr.44103) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-21T07:52:57.462 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:57 smithi080 bash[40414]: cephadm 2024-01-21T07:52:56.037974+0000 mgr.y (mgr.44103) 82 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: cluster 2024-01-21T07:52:56.825875+0000 mgr.y (mgr.44103) 83 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: cephadm 2024-01-21T07:52:57.994511+0000 mgr.y (mgr.44103) 84 : cephadm [INF] Upgrade: Updating osd.0 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: audit 2024-01-21T07:52:58.003611+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: audit 2024-01-21T07:52:58.005330+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: audit 2024-01-21T07:52:58.006563+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: cephadm 2024-01-21T07:52:58.009664+0000 mgr.y (mgr.44103) 85 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-01-21T07:52:58.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:58 smithi195 bash[30911]: audit 2024-01-21T07:52:58.010670+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-01-21T07:52:58.558 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: cluster 2024-01-21T07:52:56.825875+0000 mgr.y (mgr.44103) 83 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: cephadm 2024-01-21T07:52:57.994511+0000 mgr.y (mgr.44103) 84 : cephadm [INF] Upgrade: Updating osd.0 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: audit 2024-01-21T07:52:58.003611+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: audit 2024-01-21T07:52:58.005330+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: audit 2024-01-21T07:52:58.006563+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: cephadm 2024-01-21T07:52:58.009664+0000 mgr.y (mgr.44103) 85 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[38631]: audit 2024-01-21T07:52:58.010670+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: cluster 2024-01-21T07:52:56.825875+0000 mgr.y (mgr.44103) 83 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: cephadm 2024-01-21T07:52:57.994511+0000 mgr.y (mgr.44103) 84 : cephadm [INF] Upgrade: Updating osd.0 2024-01-21T07:52:58.559 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: audit 2024-01-21T07:52:58.003611+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:52:58.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: audit 2024-01-21T07:52:58.005330+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-21T07:52:58.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: audit 2024-01-21T07:52:58.006563+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-21T07:52:58.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: cephadm 2024-01-21T07:52:58.009664+0000 mgr.y (mgr.44103) 85 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-01-21T07:52:58.560 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:58 smithi080 bash[40414]: audit 2024-01-21T07:52:58.010670+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-01-21T07:52:59.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:52:59 smithi195 bash[30911]: cluster 2024-01-21T07:52:58.826670+0000 mgr.y (mgr.44103) 86 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:59.427 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:52:59 smithi080 bash[38631]: cluster 2024-01-21T07:52:58.826670+0000 mgr.y (mgr.44103) 86 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:52:59.427 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:52:59 smithi080 bash[40414]: cluster 2024-01-21T07:52:58.826670+0000 mgr.y (mgr.44103) 86 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:02.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:01 smithi080 bash[38631]: cluster 2024-01-21T07:53:00.827348+0000 mgr.y (mgr.44103) 87 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:02.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:01 smithi080 bash[40414]: cluster 2024-01-21T07:53:00.827348+0000 mgr.y (mgr.44103) 87 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:02.059 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:01 smithi080 systemd[1]: Stopping Ceph osd.0 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:02.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:01 smithi195 bash[30911]: cluster 2024-01-21T07:53:00.827348+0000 mgr.y (mgr.44103) 87 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:02.558 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[19444]: debug 2024-01-21T07:53:02.058+0000 7fdd2e2dc700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:02.558 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[19444]: debug 2024-01-21T07:53:02.058+0000 7fdd2e2dc700 -1 osd.0 65 *** Got signal Terminated *** 2024-01-21T07:53:02.559 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[19444]: debug 2024-01-21T07:53:02.058+0000 7fdd2e2dc700 -1 osd.0 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:03.016 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[41995]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.0 2024-01-21T07:53:03.016 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[42063]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.0 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.360019+0000 mon.a (mon.0) 263 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.360128+0000 mon.a (mon.0) 264 : cluster [INF] osd.0 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.360631+0000 mon.a (mon.0) 265 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.360886+0000 mon.a (mon.0) 266 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.361463+0000 mon.a (mon.0) 267 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.362238+0000 mon.a (mon.0) 268 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.362790+0000 mon.a (mon.0) 269 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.363041+0000 mon.a (mon.0) 270 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.363432+0000 mon.a (mon.0) 271 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.363787+0000 mon.a (mon.0) 272 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.364207+0000 mon.a (mon.0) 273 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.364596+0000 mon.a (mon.0) 274 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.364944+0000 mon.a (mon.0) 275 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.017 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.365318+0000 mon.a (mon.0) 276 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.365682+0000 mon.a (mon.0) 277 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.764059+0000 mon.a (mon.0) 278 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.764404+0000 mon.a (mon.0) 279 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.764690+0000 mon.a (mon.0) 280 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.765025+0000 mon.a (mon.0) 281 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.765442+0000 mon.a (mon.0) 282 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.765940+0000 mon.a (mon.0) 283 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.766327+0000 mon.a (mon.0) 284 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.766764+0000 mon.a (mon.0) 285 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.766913+0000 mon.a (mon.0) 286 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.767178+0000 mon.a (mon.0) 287 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.767351+0000 mon.a (mon.0) 288 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.767459+0000 mon.a (mon.0) 289 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.767704+0000 mon.a (mon.0) 290 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.767808+0000 mon.a (mon.0) 291 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.360019+0000 mon.a (mon.0) 263 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.360128+0000 mon.a (mon.0) 264 : cluster [INF] osd.0 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.360631+0000 mon.a (mon.0) 265 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.360886+0000 mon.a (mon.0) 266 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.361463+0000 mon.a (mon.0) 267 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.362238+0000 mon.a (mon.0) 268 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.362790+0000 mon.a (mon.0) 269 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.363041+0000 mon.a (mon.0) 270 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.363432+0000 mon.a (mon.0) 271 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.363787+0000 mon.a (mon.0) 272 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.364207+0000 mon.a (mon.0) 273 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.364596+0000 mon.a (mon.0) 274 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.364944+0000 mon.a (mon.0) 275 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.365318+0000 mon.a (mon.0) 276 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.365682+0000 mon.a (mon.0) 277 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.764059+0000 mon.a (mon.0) 278 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.764404+0000 mon.a (mon.0) 279 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.764690+0000 mon.a (mon.0) 280 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.765025+0000 mon.a (mon.0) 281 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.765442+0000 mon.a (mon.0) 282 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.765940+0000 mon.a (mon.0) 283 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.766327+0000 mon.a (mon.0) 284 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.766764+0000 mon.a (mon.0) 285 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.766913+0000 mon.a (mon.0) 286 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.767178+0000 mon.a (mon.0) 287 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.767351+0000 mon.a (mon.0) 288 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.767459+0000 mon.a (mon.0) 289 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.767704+0000 mon.a (mon.0) 290 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.767808+0000 mon.a (mon.0) 291 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.021 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:02 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:53:02] "GET /metrics HTTP/1.1" 200 146494 "" "Prometheus/2.33.4" 2024-01-21T07:53:03.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.360019+0000 mon.a (mon.0) 263 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.360128+0000 mon.a (mon.0) 264 : cluster [INF] osd.0 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.360631+0000 mon.a (mon.0) 265 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.360886+0000 mon.a (mon.0) 266 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.361463+0000 mon.a (mon.0) 267 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.362238+0000 mon.a (mon.0) 268 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.362790+0000 mon.a (mon.0) 269 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.363041+0000 mon.a (mon.0) 270 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.363432+0000 mon.a (mon.0) 271 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.363787+0000 mon.a (mon.0) 272 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.364207+0000 mon.a (mon.0) 273 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.364596+0000 mon.a (mon.0) 274 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.364944+0000 mon.a (mon.0) 275 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.365318+0000 mon.a (mon.0) 276 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.365682+0000 mon.a (mon.0) 277 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.764059+0000 mon.a (mon.0) 278 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.764404+0000 mon.a (mon.0) 279 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.764690+0000 mon.a (mon.0) 280 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.765025+0000 mon.a (mon.0) 281 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.765442+0000 mon.a (mon.0) 282 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.765940+0000 mon.a (mon.0) 283 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.766327+0000 mon.a (mon.0) 284 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.766764+0000 mon.a (mon.0) 285 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.766913+0000 mon.a (mon.0) 286 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.767178+0000 mon.a (mon.0) 287 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.767351+0000 mon.a (mon.0) 288 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.767459+0000 mon.a (mon.0) 289 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.767704+0000 mon.a (mon.0) 290 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-01-21T07:53:03.391 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:02 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.767808+0000 mon.a (mon.0) 291 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-01-21T07:53:04.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.828814+0000 mgr.y (mgr.44103) 88 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:04.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.885834+0000 mon.a (mon.0) 292 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[38631]: cluster 2024-01-21T07:53:02.905682+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[38631]: audit 2024-01-21T07:53:02.906244+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[38631]: audit 2024-01-21T07:53:02.907610+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.828814+0000 mgr.y (mgr.44103) 88 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.885834+0000 mon.a (mon.0) 292 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[40414]: cluster 2024-01-21T07:53:02.905682+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[40414]: audit 2024-01-21T07:53:02.906244+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:53:04.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:03 smithi080 bash[40414]: audit 2024-01-21T07:53:02.907610+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:53:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:03 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.828814+0000 mgr.y (mgr.44103) 88 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:03 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.885834+0000 mon.a (mon.0) 292 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-01-21T07:53:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:03 smithi195 bash[30911]: cluster 2024-01-21T07:53:02.905682+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2024-01-21T07:53:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:03 smithi195 bash[30911]: audit 2024-01-21T07:53:02.906244+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-21T07:53:04.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:03 smithi195 bash[30911]: audit 2024-01-21T07:53:02.907610+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-01-21T07:53:05.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:04 smithi080 bash[38631]: audit 2024-01-21T07:53:03.905779+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:53:05.310 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:04 smithi080 bash[38631]: cluster 2024-01-21T07:53:03.906042+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-01-21T07:53:05.310 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:04 smithi080 bash[40414]: audit 2024-01-21T07:53:03.905779+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:53:05.311 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:04 smithi080 bash[40414]: cluster 2024-01-21T07:53:03.906042+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-01-21T07:53:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:04 smithi195 bash[30911]: audit 2024-01-21T07:53:03.905779+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-01-21T07:53:05.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:04 smithi195 bash[30911]: cluster 2024-01-21T07:53:03.906042+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-01-21T07:53:05.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph orch ps' 2024-01-21T07:53:06.101 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:05 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.0.service: Succeeded. 2024-01-21T07:53:06.102 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:05 smithi080 systemd[1]: Stopped Ceph osd.0 for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:53:06.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:05 smithi080 bash[38631]: cluster 2024-01-21T07:53:04.829543+0000 mgr.y (mgr.44103) 89 : cluster [DBG] pgmap v47: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:06.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:05 smithi080 bash[40414]: cluster 2024-01-21T07:53:04.829543+0000 mgr.y (mgr.44103) 89 : cluster [DBG] pgmap v47: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:06.308 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:05 smithi080 systemd[1]: Started Ceph osd.0 for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:53:06.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:05 smithi195 bash[30911]: cluster 2024-01-21T07:53:04.829543+0000 mgr.y (mgr.44103) 89 : cluster [DBG] pgmap v47: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-01-21T07:53:07.020 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:53:06 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:53:06] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:53:07.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:07 smithi080 bash[38631]: audit 2024-01-21T07:53:06.010483+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:07.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:07 smithi080 bash[38631]: audit 2024-01-21T07:53:06.011783+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:53:07.299 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:07 smithi080 bash[38631]: audit 2024-01-21T07:53:06.014070+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:53:07.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:07 smithi080 bash[40414]: audit 2024-01-21T07:53:06.010483+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:07.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:07 smithi080 bash[40414]: audit 2024-01-21T07:53:06.011783+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:53:07.300 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:07 smithi080 bash[40414]: audit 2024-01-21T07:53:06.014070+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:53:07.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:07 smithi195 bash[30911]: audit 2024-01-21T07:53:06.010483+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:07.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:07 smithi195 bash[30911]: audit 2024-01-21T07:53:06.011783+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:53:07.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:07 smithi195 bash[30911]: audit 2024-01-21T07:53:06.014070+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-01-21T07:53:08.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[38631]: cluster 2024-01-21T07:53:06.831378+0000 mgr.y (mgr.44103) 90 : cluster [DBG] pgmap v48: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:08.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[38631]: cluster 2024-01-21T07:53:07.007985+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 20 pgs degraded (PG_DEGRADED) 2024-01-21T07:53:08.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[40414]: cluster 2024-01-21T07:53:06.831378+0000 mgr.y (mgr.44103) 90 : cluster [DBG] pgmap v48: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:08.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[40414]: cluster 2024-01-21T07:53:07.007985+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 20 pgs degraded (PG_DEGRADED) 2024-01-21T07:53:08.309 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-21T07:53:08.309 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-01-21T07:53:08.309 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-01-21T07:53:08.309 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-01-21T07:53:08.309 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-01-21T07:53:08.309 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-21T07:53:08.310 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:08 smithi080 bash[42318]: --> ceph-volume raw activate successful for osd ID: 0 2024-01-21T07:53:08.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:08 smithi195 bash[30911]: cluster 2024-01-21T07:53:06.831378+0000 mgr.y (mgr.44103) 90 : cluster [DBG] pgmap v48: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:08.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:08 smithi195 bash[30911]: cluster 2024-01-21T07:53:07.007985+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 20 pgs degraded (PG_DEGRADED) 2024-01-21T07:53:10.308 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:10 smithi080 bash[40414]: cluster 2024-01-21T07:53:08.832368+0000 mgr.y (mgr.44103) 91 : cluster [DBG] pgmap v49: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:10.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:10 smithi080 bash[38631]: cluster 2024-01-21T07:53:08.832368+0000 mgr.y (mgr.44103) 91 : cluster [DBG] pgmap v49: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:10.388 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:10 smithi195 bash[30911]: cluster 2024-01-21T07:53:08.832368+0000 mgr.y (mgr.44103) 91 : cluster [DBG] pgmap v49: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:10.550 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-21T07:53:10.550 INFO:teuthology.orchestra.run.smithi080.stdout:alertmanager.a smithi080 *:9093,9094 running (3m) 57s ago 3m 16.7M - 0.23.0 ba2b418f427c a9d41607da45 2024-01-21T07:53:10.550 INFO:teuthology.orchestra.run.smithi080.stdout:grafana.a smithi195 running (2m) 43s ago 9m 25.2M - 6.6.2 87a51ecf0b1c ccb48473f95f 2024-01-21T07:53:10.550 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi195 *:8443,9283 running (110s) 43s ago 14m 379M - 16.2.14-454-gea310589 9b28eb2d7c37 2a953d798d62 2024-01-21T07:53:10.550 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi080 *:8443,9283 running (2m) 57s ago 16m 416M - 16.2.14-454-gea310589 9b28eb2d7c37 8c9e9c0849f8 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (98s) 57s ago 16m 40.0M 2048M 16.2.14-454-gea310589 9b28eb2d7c37 adb38d0cf6a5 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi195 running (51s) 43s ago 14m 45.8M 2048M 16.2.14-454-gea310589 9b28eb2d7c37 5ecbb74e8296 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi080 running (68s) 57s ago 14m 44.2M 2048M 16.2.14-454-gea310589 9b28eb2d7c37 432ec676d8b3 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.a smithi080 error 57s ago 10m - - 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:node-exporter.b smithi195 error 43s ago 10m - - 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 starting - - - 4096M 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi080 running (13m) 57s ago 13m 52.2M 4096M 15.2.0 204a01f9b0b6 b7790bbaecb5 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi080 running (13m) 57s ago 13m 46.4M 4096M 15.2.0 204a01f9b0b6 35b06ffa44ef 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (12m) 57s ago 12m 48.3M 4096M 15.2.0 204a01f9b0b6 4a4be448f50b 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi195 running (12m) 43s ago 12m 48.9M 4096M 15.2.0 204a01f9b0b6 5587796ebacc 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi195 running (11m) 43s ago 11m 48.7M 4096M 15.2.0 204a01f9b0b6 b386458d6202 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi195 running (11m) 43s ago 11m 47.6M 4096M 15.2.0 204a01f9b0b6 db8e03aabfc7 2024-01-21T07:53:10.551 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi195 running (10m) 43s ago 11m 50.3M 4096M 15.2.0 204a01f9b0b6 048583616e4b 2024-01-21T07:53:10.552 INFO:teuthology.orchestra.run.smithi080.stdout:prometheus.a smithi195 *:9095 running (3m) 43s ago 3m 50.7M - 2.33.4 514e6a882f6e 9c7157bf1685 2024-01-21T07:53:10.552 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi080.bytdbv smithi080 running (8m) 57s ago 8m 51.0M - 15.2.0 204a01f9b0b6 f404329a2d0a 2024-01-21T07:53:10.552 INFO:teuthology.orchestra.run.smithi080.stdout:rgw.r.z.smithi195.uawmcm smithi195 running (8m) 43s ago 8m 50.4M - 15.2.0 204a01f9b0b6 f3f8703227f6 2024-01-21T07:53:10.841 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:10 smithi080 bash[42664]: debug 2024-01-21T07:53:10.678+0000 7effa9663700 1 -- 172.21.15.80:0/4237806352 <== mon.1 v2:172.21.15.80:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55abf42e0680 con 0x55abf4353400 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.525018+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.526032+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.526846+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.527654+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.528483+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.529258+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.534717+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.535522+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.536254+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.537058+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.236 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[40414]: audit 2024-01-21T07:53:10.537804+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.525018+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.526032+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.526846+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.527654+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.528483+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.529258+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.534717+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.535522+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.237 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.536254+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.537058+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[38631]: audit 2024-01-21T07:53:10.537804+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph versions' 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.525018+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.526032+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.526846+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.527654+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.528483+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.529258+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.534717+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-01-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.535522+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.536254+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.537058+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.390 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:11 smithi195 bash[30911]: audit 2024-01-21T07:53:10.537804+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-01-21T07:53:11.486 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:11 smithi080 bash[42664]: debug 2024-01-21T07:53:11.230+0000 7effb10f0380 -1 Falling back to public interface 2024-01-21T07:53:12.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:12 smithi080 bash[38631]: audit 2024-01-21T07:53:10.522540+0000 mgr.y (mgr.44103) 92 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:53:12.308 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:12 smithi080 bash[38631]: cluster 2024-01-21T07:53:10.833485+0000 mgr.y (mgr.44103) 93 : cluster [DBG] pgmap v50: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:12.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:12 smithi080 bash[40414]: audit 2024-01-21T07:53:10.522540+0000 mgr.y (mgr.44103) 92 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:53:12.309 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:12 smithi080 bash[40414]: cluster 2024-01-21T07:53:10.833485+0000 mgr.y (mgr.44103) 93 : cluster [DBG] pgmap v50: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:12.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:12 smithi195 bash[30911]: audit 2024-01-21T07:53:10.522540+0000 mgr.y (mgr.44103) 92 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-21T07:53:12.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:12 smithi195 bash[30911]: cluster 2024-01-21T07:53:10.833485+0000 mgr.y (mgr.44103) 93 : cluster [DBG] pgmap v50: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:13.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:12 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:53:12] "GET /metrics HTTP/1.1" 200 146494 "" "Prometheus/2.33.4" 2024-01-21T07:53:13.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:13 smithi195 bash[30911]: cluster 2024-01-21T07:53:12.835254+0000 mgr.y (mgr.44103) 94 : cluster [DBG] pgmap v51: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:13.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:13 smithi080 bash[38631]: cluster 2024-01-21T07:53:12.835254+0000 mgr.y (mgr.44103) 94 : cluster [DBG] pgmap v51: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:13.893 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:13 smithi080 bash[40414]: cluster 2024-01-21T07:53:12.835254+0000 mgr.y (mgr.44103) 94 : cluster [DBG] pgmap v51: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:14.427 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": { 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 3 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": { 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 2 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": { 2024-01-21T07:53:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": {}, 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": { 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: "overall": { 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph version 16.2.14-454-gea310589 (ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec) pacific (stable)": 5 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-01-21T07:53:14.429 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-01-21T07:53:14.615 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:14 smithi080 bash[42664]: debug 2024-01-21T07:53:14.330+0000 7effb10f0380 -1 osd.0 65 log_to_monitors {default=true} 2024-01-21T07:53:14.888 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:14 smithi195 bash[30911]: audit 2024-01-21T07:53:14.335504+0000 mon.a (mon.0) 313 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:53:14.889 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:14 smithi195 bash[30911]: audit 2024-01-21T07:53:14.425422+0000 mon.a (mon.0) 314 : audit [DBG] from='client.? 172.21.15.80:0/2993837332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.059 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:14 smithi080 bash[42664]: debug 2024-01-21T07:53:14.650+0000 7effa05d4700 -1 osd.0 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T07:53:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:14 smithi080 bash[40414]: audit 2024-01-21T07:53:14.335504+0000 mon.a (mon.0) 313 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:53:15.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:14 smithi080 bash[40414]: audit 2024-01-21T07:53:14.425422+0000 mon.a (mon.0) 314 : audit [DBG] from='client.? 172.21.15.80:0/2993837332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:14 smithi080 bash[38631]: audit 2024-01-21T07:53:14.335504+0000 mon.a (mon.0) 313 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-21T07:53:15.060 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:14 smithi080 bash[38631]: audit 2024-01-21T07:53:14.425422+0000 mon.a (mon.0) 314 : audit [DBG] from='client.? 172.21.15.80:0/2993837332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-01-21T07:53:15.808 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[36925]: debug 2024-01-21T07:53:15.522+0000 7faad1343700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:14.637276+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: cluster 2024-01-21T07:53:14.637355+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:14.640353+0000 mon.a (mon.0) 317 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: cluster 2024-01-21T07:53:14.836155+0000 mgr.y (mgr.44103) 95 : cluster [DBG] pgmap v53: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.223472+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.504330+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.513062+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:53:15.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.517354+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.519658+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.521564+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[38631]: audit 2024-01-21T07:53:15.524029+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:14.637276+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: cluster 2024-01-21T07:53:14.637355+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:14.640353+0000 mon.a (mon.0) 317 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: cluster 2024-01-21T07:53:14.836155+0000 mgr.y (mgr.44103) 95 : cluster [DBG] pgmap v53: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.223472+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.504330+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:15.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.513062+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:53:15.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.517354+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.519658+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.521564+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:15.811 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:15 smithi080 bash[40414]: audit 2024-01-21T07:53:15.524029+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:14.637276+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: cluster 2024-01-21T07:53:14.637355+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:14.640353+0000 mon.a (mon.0) 317 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: cluster 2024-01-21T07:53:14.836155+0000 mgr.y (mgr.44103) 95 : cluster [DBG] pgmap v53: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.223472+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.504330+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:16.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.513062+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-21T07:53:16.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.517354+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:16.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.519658+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:16.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.521564+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:16.140 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:15 smithi195 bash[30911]: audit 2024-01-21T07:53:15.524029+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cluster 2024-01-21T07:53:15.496237+0000 mgr.y (mgr.44103) 96 : cluster [DBG] pgmap v54: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cluster 2024-01-21T07:53:15.496587+0000 mgr.y (mgr.44103) 97 : cluster [DBG] pgmap v55: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: audit 2024-01-21T07:53:15.524310+0000 mgr.y (mgr.44103) 98 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cephadm 2024-01-21T07:53:15.525673+0000 mgr.y (mgr.44103) 99 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cluster 2024-01-21T07:53:15.634942+0000 mon.a (mon.0) 325 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cluster 2024-01-21T07:53:15.644059+0000 mon.a (mon.0) 326 : cluster [INF] osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377] boot 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cluster 2024-01-21T07:53:15.644147+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: audit 2024-01-21T07:53:15.649217+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:53:16.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[38631]: cluster 2024-01-21T07:53:16.651036+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cluster 2024-01-21T07:53:15.496237+0000 mgr.y (mgr.44103) 96 : cluster [DBG] pgmap v54: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cluster 2024-01-21T07:53:15.496587+0000 mgr.y (mgr.44103) 97 : cluster [DBG] pgmap v55: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: audit 2024-01-21T07:53:15.524310+0000 mgr.y (mgr.44103) 98 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cephadm 2024-01-21T07:53:15.525673+0000 mgr.y (mgr.44103) 99 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cluster 2024-01-21T07:53:15.634942+0000 mon.a (mon.0) 325 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cluster 2024-01-21T07:53:15.644059+0000 mon.a (mon.0) 326 : cluster [INF] osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377] boot 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cluster 2024-01-21T07:53:15.644147+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: audit 2024-01-21T07:53:15.649217+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:53:16.810 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:16 smithi080 bash[40414]: cluster 2024-01-21T07:53:16.651036+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[29223]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:53:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cluster 2024-01-21T07:53:15.496237+0000 mgr.y (mgr.44103) 96 : cluster [DBG] pgmap v54: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cluster 2024-01-21T07:53:15.496587+0000 mgr.y (mgr.44103) 97 : cluster [DBG] pgmap v55: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: audit 2024-01-21T07:53:15.524310+0000 mgr.y (mgr.44103) 98 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cephadm 2024-01-21T07:53:15.525673+0000 mgr.y (mgr.44103) 99 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cluster 2024-01-21T07:53:15.634942+0000 mon.a (mon.0) 325 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cluster 2024-01-21T07:53:15.644059+0000 mon.a (mon.0) 326 : cluster [INF] osd.0 [v2:172.21.15.80:6802/3632382377,v1:172.21.15.80:6803/3632382377] boot 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cluster 2024-01-21T07:53:15.644147+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: audit 2024-01-21T07:53:15.649217+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-21T07:53:17.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:16 smithi195 bash[30911]: cluster 2024-01-21T07:53:16.651036+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-01-21T07:53:18.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:17 smithi080 bash[38631]: audit 2024-01-21T07:53:16.785752+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:18.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:17 smithi080 bash[40414]: audit 2024-01-21T07:53:16.785752+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:18.138 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:17 smithi195 bash[30911]: audit 2024-01-21T07:53:16.785752+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.44103 172.21.15.80:0/48301461' entity='mgr.y' 2024-01-21T07:53:18.695 INFO:teuthology.orchestra.run.smithi080.stdout:false 2024-01-21T07:53:19.058 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:18 smithi080 bash[38631]: cluster 2024-01-21T07:53:17.497403+0000 mgr.y (mgr.44103) 100 : cluster [DBG] pgmap v58: 129 pgs: 33 peering, 7 active+undersized+degraded, 9 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 28/606 objects degraded (4.620%) 2024-01-21T07:53:19.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:18 smithi080 bash[38631]: cluster 2024-01-21T07:53:17.781647+0000 mon.a (mon.0) 331 : cluster [WRN] Health check update: Degraded data redundancy: 28/606 objects degraded (4.620%), 7 pgs degraded (PG_DEGRADED) 2024-01-21T07:53:19.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:18 smithi080 bash[38631]: audit 2024-01-21T07:53:18.679993+0000 mon.c (mon.1) 3 : audit [DBG] from='client.44160 172.21.15.80:0/2426791154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:19.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:18 smithi080 bash[40414]: cluster 2024-01-21T07:53:17.497403+0000 mgr.y (mgr.44103) 100 : cluster [DBG] pgmap v58: 129 pgs: 33 peering, 7 active+undersized+degraded, 9 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 28/606 objects degraded (4.620%) 2024-01-21T07:53:19.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:18 smithi080 bash[40414]: cluster 2024-01-21T07:53:17.781647+0000 mon.a (mon.0) 331 : cluster [WRN] Health check update: Degraded data redundancy: 28/606 objects degraded (4.620%), 7 pgs degraded (PG_DEGRADED) 2024-01-21T07:53:19.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:18 smithi080 bash[40414]: audit 2024-01-21T07:53:18.679993+0000 mon.c (mon.1) 3 : audit [DBG] from='client.44160 172.21.15.80:0/2426791154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:19.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:18 smithi195 bash[30911]: cluster 2024-01-21T07:53:17.497403+0000 mgr.y (mgr.44103) 100 : cluster [DBG] pgmap v58: 129 pgs: 33 peering, 7 active+undersized+degraded, 9 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 28/606 objects degraded (4.620%) 2024-01-21T07:53:19.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:18 smithi195 bash[30911]: cluster 2024-01-21T07:53:17.781647+0000 mon.a (mon.0) 331 : cluster [WRN] Health check update: Degraded data redundancy: 28/606 objects degraded (4.620%), 7 pgs degraded (PG_DEGRADED) 2024-01-21T07:53:19.139 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:18 smithi195 bash[30911]: audit 2024-01-21T07:53:18.679993+0000 mon.c (mon.1) 3 : audit [DBG] from='client.44160 172.21.15.80:0/2426791154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-21T07:53:19.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T07:53:19.415 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa/tasks/cephadm.py", line 1058, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2024-01-21T07:53:19.631 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7ab95b784773411ea3ecfb0c146ec6c3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa/tasks/cephadm.py", line 1058, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2024-01-21T07:53:19.634 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-01-21T07:53:19.644 INFO:tasks.cephadm:Teardown begin 2024-01-21T07:53:19.644 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:53:19.663 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:53:19.680 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-01-21T07:53:19.681 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-21T07:53:19.713 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-21T07:53:19.727 INFO:tasks.cephadm:Stopping all daemons... 2024-01-21T07:53:19.728 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-01-21T07:53:19.728 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a 2024-01-21T07:53:20.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:19 smithi080 systemd[1]: Stopping Ceph mon.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:20.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[43723]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.a 2024-01-21T07:53:20.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[38631]: debug 2024-01-21T07:53:19.897+0000 7eff0ee79700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-01-21T07:53:20.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[38631]: debug 2024-01-21T07:53:19.897+0000 7eff0ee79700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-01-21T07:53:20.036 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[36925]: [21/Jan/2024:07:53:19] ENGINE Bus STOPPING 2024-01-21T07:53:20.036 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[36925]: [21/Jan/2024:07:53:19] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-21T07:53:20.036 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[36925]: [21/Jan/2024:07:53:19] ENGINE Bus STOPPED 2024-01-21T07:53:20.036 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:19 smithi080 bash[36925]: [21/Jan/2024:07:53:19] ENGINE Bus STARTING 2024-01-21T07:53:20.308 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:20 smithi080 bash[36925]: [21/Jan/2024:07:53:20] ENGINE Serving on http://:::9283 2024-01-21T07:53:20.309 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:20 smithi080 bash[36925]: [21/Jan/2024:07:53:20] ENGINE Bus STARTED 2024-01-21T07:53:20.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.a.service' 2024-01-21T07:53:20.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:20.769 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-01-21T07:53:20.769 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-01-21T07:53:20.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.c 2024-01-21T07:53:21.058 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:20 smithi080 systemd[1]: Stopping Ceph mon.c for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:21.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:20 smithi080 bash[43844]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.c 2024-01-21T07:53:21.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:21 smithi080 bash[40414]: debug 2024-01-21T07:53:20.997+0000 7f5421c3a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-01-21T07:53:21.059 INFO:journalctl@ceph.mon.c.smithi080.stdout:Jan 21 07:53:21 smithi080 bash[40414]: debug 2024-01-21T07:53:20.997+0000 7f5421c3a700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-01-21T07:53:21.966 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.c.service' 2024-01-21T07:53:21.996 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:21.997 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-01-21T07:53:21.997 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-01-21T07:53:21.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.b 2024-01-21T07:53:22.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:22 smithi195 systemd[1]: Stopping Ceph mon.b for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:22.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:22 smithi195 bash[32105]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mon.b 2024-01-21T07:53:22.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:22 smithi195 bash[30911]: debug 2024-01-21T07:53:22.189+0000 7f50e365a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-01-21T07:53:22.389 INFO:journalctl@ceph.mon.b.smithi195.stdout:Jan 21 07:53:22 smithi195 bash[30911]: debug 2024-01-21T07:53:22.189+0000 7f50e365a700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-01-21T07:53:23.058 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:22 smithi080 bash[36925]: ::ffff:172.21.15.195 - - [21/Jan/2024:07:53:22] "GET /metrics HTTP/1.1" 200 160422 "" "Prometheus/2.33.4" 2024-01-21T07:53:23.325 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mon.b.service' 2024-01-21T07:53:23.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:23.365 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-01-21T07:53:23.365 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-01-21T07:53:23.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y 2024-01-21T07:53:23.755 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:23 smithi080 systemd[1]: Stopping Ceph mgr.y for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:23.756 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:23 smithi080 bash[43960]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.y 2024-01-21T07:53:23.756 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:23 smithi080 bash[36925]: debug 2024-01-21T07:53:23.557+0000 7faafc196700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-01-21T07:53:23.756 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Jan 21 07:53:23 smithi080 bash[36925]: debug 2024-01-21T07:53:23.557+0000 7faafc196700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-21T07:53:24.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.y.service' 2024-01-21T07:53:24.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:24.361 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-01-21T07:53:24.362 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-01-21T07:53:24.362 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x 2024-01-21T07:53:24.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:24 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:24.241Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:53:24.638 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:53:24 smithi195 systemd[1]: Stopping Ceph mgr.x for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:24.639 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Jan 21 07:53:24 smithi195 bash[32229]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-mgr.x 2024-01-21T07:53:25.304 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@mgr.x.service' 2024-01-21T07:53:25.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:25.333 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-01-21T07:53:25.334 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-01-21T07:53:25.334 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.0 2024-01-21T07:53:25.808 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:25 smithi080 systemd[1]: Stopping Ceph osd.0 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:25.809 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:25 smithi080 bash[44077]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.0 2024-01-21T07:53:25.809 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:25 smithi080 bash[42664]: debug 2024-01-21T07:53:25.549+0000 7effa8661700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-01-21T07:53:25.809 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:25 smithi080 bash[42664]: debug 2024-01-21T07:53:25.549+0000 7effa8661700 -1 osd.0 70 *** Got signal Terminated *** 2024-01-21T07:53:25.809 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:25 smithi080 bash[42664]: debug 2024-01-21T07:53:25.549+0000 7effa8661700 -1 osd.0 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:31.495 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:31 smithi080 bash[44113]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd-0 2024-01-21T07:53:31.495 INFO:journalctl@ceph.osd.0.smithi080.stdout:Jan 21 07:53:31 smithi080 bash[44187]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd-0 2024-01-21T07:53:33.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.0.service' 2024-01-21T07:53:33.488 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:33.488 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-01-21T07:53:33.488 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-01-21T07:53:33.489 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.1 2024-01-21T07:53:33.736 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:53:33 smithi080 systemd[1]: Stopping Ceph osd.1 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:33.736 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:53:33 smithi080 bash[21083]: debug 2024-01-21T07:53:33.633+0000 7fb34fe0f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:33.736 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:53:33 smithi080 bash[21083]: debug 2024-01-21T07:53:33.633+0000 7fb34fe0f700 -1 osd.1 70 *** Got signal Terminated *** 2024-01-21T07:53:33.736 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:53:33 smithi080 bash[21083]: debug 2024-01-21T07:53:33.633+0000 7fb34fe0f700 -1 osd.1 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:34.558 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:53:34 smithi080 bash[44306]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.1 2024-01-21T07:53:34.559 INFO:journalctl@ceph.osd.1.smithi080.stdout:Jan 21 07:53:34 smithi080 bash[44350]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.1/unit.stop: No such file or directory 2024-01-21T07:53:34.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:34 smithi080 bash[36089]: level=error ts=2024-01-21T07:53:34.241Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:53:34.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:34 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:34.242Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:53:34.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:34 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:34.244Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused" 2024-01-21T07:53:36.364 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.1.service' 2024-01-21T07:53:36.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:36.398 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-01-21T07:53:36.399 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-01-21T07:53:36.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.2 2024-01-21T07:53:36.615 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:53:36 smithi080 systemd[1]: Stopping Ceph osd.2 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:36.615 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:53:36 smithi080 bash[22672]: debug 2024-01-21T07:53:36.489+0000 7f59485ea700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:36.615 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:53:36 smithi080 bash[22672]: debug 2024-01-21T07:53:36.489+0000 7f59485ea700 -1 osd.2 70 *** Got signal Terminated *** 2024-01-21T07:53:36.615 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:53:36 smithi080 bash[22672]: debug 2024-01-21T07:53:36.489+0000 7f59485ea700 -1 osd.2 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:37.558 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:53:37 smithi080 bash[44438]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.2 2024-01-21T07:53:37.559 INFO:journalctl@ceph.osd.2.smithi080.stdout:Jan 21 07:53:37 smithi080 bash[44476]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.2/unit.stop: No such file or directory 2024-01-21T07:53:38.977 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.2.service' 2024-01-21T07:53:39.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:39.013 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-01-21T07:53:39.013 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-01-21T07:53:39.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.3 2024-01-21T07:53:39.228 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:53:39 smithi080 systemd[1]: Stopping Ceph osd.3 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:39.228 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:53:39 smithi080 bash[24344]: debug 2024-01-21T07:53:39.113+0000 7f818010c700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:39.228 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:53:39 smithi080 bash[24344]: debug 2024-01-21T07:53:39.113+0000 7f818010c700 -1 osd.3 70 *** Got signal Terminated *** 2024-01-21T07:53:39.229 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:53:39 smithi080 bash[24344]: debug 2024-01-21T07:53:39.113+0000 7f818010c700 -1 osd.3 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:40.058 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:53:39 smithi080 bash[44566]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.3 2024-01-21T07:53:40.059 INFO:journalctl@ceph.osd.3.smithi080.stdout:Jan 21 07:53:39 smithi080 bash[44604]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.3/unit.stop: No such file or directory 2024-01-21T07:53:41.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.3.service' 2024-01-21T07:53:41.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:41.549 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-01-21T07:53:41.550 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-01-21T07:53:41.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.4 2024-01-21T07:53:41.888 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:53:41 smithi195 systemd[1]: Stopping Ceph osd.4 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:41.889 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:53:41 smithi195 bash[16062]: debug 2024-01-21T07:53:41.697+0000 7f9becf9b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:41.889 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:53:41 smithi195 bash[16062]: debug 2024-01-21T07:53:41.697+0000 7f9becf9b700 -1 osd.4 70 *** Got signal Terminated *** 2024-01-21T07:53:41.889 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:53:41 smithi195 bash[16062]: debug 2024-01-21T07:53:41.697+0000 7f9becf9b700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:42.638 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:53:42 smithi195 bash[32356]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.4 2024-01-21T07:53:42.639 INFO:journalctl@ceph.osd.4.smithi195.stdout:Jan 21 07:53:42 smithi195 bash[32402]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.4/unit.stop: No such file or directory 2024-01-21T07:53:44.429 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.4.service' 2024-01-21T07:53:44.461 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:44.462 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-01-21T07:53:44.462 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-01-21T07:53:44.462 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.5 2024-01-21T07:53:44.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:44 smithi080 bash[36089]: level=error ts=2024-01-21T07:53:44.241Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused" 2024-01-21T07:53:44.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:44 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:44.242Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:53:44.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:44 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:44.244Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused" 2024-01-21T07:53:44.701 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:53:44 smithi195 systemd[1]: Stopping Ceph osd.5 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:44.702 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:53:44 smithi195 bash[17662]: debug 2024-01-21T07:53:44.597+0000 7fedd3c3c700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:44.702 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:53:44 smithi195 bash[17662]: debug 2024-01-21T07:53:44.597+0000 7fedd3c3c700 -1 osd.5 70 *** Got signal Terminated *** 2024-01-21T07:53:44.702 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:53:44 smithi195 bash[17662]: debug 2024-01-21T07:53:44.597+0000 7fedd3c3c700 -1 osd.5 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:45.638 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:53:45 smithi195 bash[32495]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.5 2024-01-21T07:53:45.639 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jan 21 07:53:45 smithi195 bash[32530]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.5/unit.stop: No such file or directory 2024-01-21T07:53:47.179 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.5.service' 2024-01-21T07:53:47.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:47.213 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-01-21T07:53:47.213 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-01-21T07:53:47.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.6 2024-01-21T07:53:47.594 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:53:47 smithi195 systemd[1]: Stopping Ceph osd.6 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:47.594 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:53:47 smithi195 bash[19324]: debug 2024-01-21T07:53:47.305+0000 7f0b4b0b3700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:47.594 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:53:47 smithi195 bash[19324]: debug 2024-01-21T07:53:47.309+0000 7f0b4b0b3700 -1 osd.6 70 *** Got signal Terminated *** 2024-01-21T07:53:47.595 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:53:47 smithi195 bash[19324]: debug 2024-01-21T07:53:47.309+0000 7f0b4b0b3700 -1 osd.6 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:48.368 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:53:47 smithi195 bash[32618]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.6 2024-01-21T07:53:48.368 INFO:journalctl@ceph.osd.6.smithi195.stdout:Jan 21 07:53:47 smithi195 bash[32655]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.6/unit.stop: No such file or directory 2024-01-21T07:53:49.867 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.6.service' 2024-01-21T07:53:49.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:49.897 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-01-21T07:53:49.897 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-01-21T07:53:49.897 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.7 2024-01-21T07:53:50.138 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:53:49 smithi195 systemd[1]: Stopping Ceph osd.7 for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:50.139 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:53:49 smithi195 bash[20923]: debug 2024-01-21T07:53:49.989+0000 7fc54a15b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-01-21T07:53:50.139 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:53:49 smithi195 bash[20923]: debug 2024-01-21T07:53:49.989+0000 7fc54a15b700 -1 osd.7 70 *** Got signal Terminated *** 2024-01-21T07:53:50.139 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:53:49 smithi195 bash[20923]: debug 2024-01-21T07:53:49.989+0000 7fc54a15b700 -1 osd.7 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-21T07:53:50.891 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:53:50 smithi195 bash[32743]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-osd.7 2024-01-21T07:53:50.891 INFO:journalctl@ceph.osd.7.smithi195.stdout:Jan 21 07:53:50 smithi195 bash[32781]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/osd.7/unit.stop: No such file or directory 2024-01-21T07:53:52.441 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@osd.7.service' 2024-01-21T07:53:52.473 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:52.474 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-01-21T07:53:52.474 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-01-21T07:53:52.474 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b86415d2-b82f-11ee-95b0-87774f69a715@prometheus.a 2024-01-21T07:53:52.843 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 systemd[1]: Stopping Ceph prometheus.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:53:52.843 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[32870]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-prometheus.a 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-01-21T07:53:52.844 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-01-21T07:53:52.845 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.644Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-01-21T07:53:52.845 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.645Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-01-21T07:53:52.845 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.645Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-01-21T07:53:52.845 INFO:journalctl@ceph.prometheus.a.smithi195.stdout:Jan 21 07:53:52 smithi195 bash[26660]: ts=2024-01-21T07:53:52.645Z caller=main.go:1066 level=info msg="See you next time!" 2024-01-21T07:53:53.425 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86415d2-b82f-11ee-95b0-87774f69a715@prometheus.a.service' 2024-01-21T07:53:53.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-21T07:53:53.455 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-01-21T07:53:53.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b86415d2-b82f-11ee-95b0-87774f69a715 --force --keep-logs 2024-01-21T07:53:53.562 INFO:teuthology.orchestra.run.smithi080.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-01-21T07:53:53.563 INFO:teuthology.orchestra.run.smithi080.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-01-21T07:53:53.563 INFO:teuthology.orchestra.run.smithi080.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-01-21T07:53:53.563 INFO:teuthology.orchestra.run.smithi080.stderr: [--retry RETRY] 2024-01-21T07:53:53.563 INFO:teuthology.orchestra.run.smithi080.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-01-21T07:53:53.563 INFO:teuthology.orchestra.run.smithi080.stderr: ... 2024-01-21T07:53:53.563 INFO:teuthology.orchestra.run.smithi080.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-01-21T07:53:53.571 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-01-21T07:53:53.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b86415d2-b82f-11ee-95b0-87774f69a715 --force --keep-logs 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr: [--retry RETRY] 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr: ... 2024-01-21T07:53:53.687 INFO:teuthology.orchestra.run.smithi195.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-01-21T07:53:53.696 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-01-21T07:53:53.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:53:53.713 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-21T07:53:53.728 INFO:tasks.cephadm:Archiving crash dumps... 2024-01-21T07:53:53.729 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/remote/ubuntu@smithi080.front.sepia.ceph.com/crash 2024-01-21T07:53:53.730 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/crash -- . 2024-01-21T07:53:53.773 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/remote/ubuntu@smithi195.front.sepia.ceph.com/crash 2024-01-21T07:53:53.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/crash -- . 2024-01-21T07:53:53.792 INFO:tasks.cephadm:Checking cluster log for badness... 2024-01-21T07:53:53.792 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-01-21T07:53:53.807 INFO:teuthology.orchestra.run.smithi080.stderr:grep: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph.log: No such file or directory 2024-01-21T07:53:53.809 INFO:tasks.cephadm:Compressing logs... 2024-01-21T07:53:53.809 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-21T07:53:53.812 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-21T07:53:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-01-21T07:53:53.837 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-21T07:53:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.a.log 2024-01-21T07:53:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mgr.y.log 2024-01-21T07:53:53.839 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-client.rgw.r.z.smithi080.bytdbv.log 2024-01-21T07:53:53.841 INFO:teuthology.orchestra.run.smithi080.stderr: 89.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-21T07:53:53.841 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.c.log 2024-01-21T07:53:53.841 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mgr.y.log: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-client.rgw.r.z.smithi080.bytdbv.log: 58.2% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-client.rgw.r.z.smithi080.bytdbv.log.gz 2024-01-21T07:53:53.841 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.1.log 2024-01-21T07:53:53.842 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.0.log 2024-01-21T07:53:53.842 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.3.log 2024-01-21T07:53:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.1.log: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-volume.log 2024-01-21T07:53:53.852 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.2.log 2024-01-21T07:53:53.853 INFO:teuthology.orchestra.run.smithi195.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-01-21T07:53:53.860 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-volume.log: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.2.log: 91.3% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-volume.log.gz 2024-01-21T07:53:53.863 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-21T07:53:53.864 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.b.log 2024-01-21T07:53:53.865 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.5.log 2024-01-21T07:53:53.865 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mgr.x.log 2024-01-21T07:53:53.866 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.6.log 2024-01-21T07:53:53.866 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.5.log: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mgr.x.log: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-21T07:53:53.867 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-client.rgw.r.z.smithi195.uawmcm.log 2024-01-21T07:53:53.867 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.4.log 2024-01-21T07:53:53.868 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-client.rgw.r.z.smithi195.uawmcm.log: gzip 58.2% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-client.rgw.r.z.smithi195.uawmcm.log.gz 2024-01-21T07:53:53.868 INFO:teuthology.orchestra.run.smithi195.stderr:-5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-volume.log 2024-01-21T07:53:53.869 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.7.log 2024-01-21T07:53:53.877 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.4.log: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-volume.log: /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.7.log: 91.1% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-volume.log.gz 2024-01-21T07:53:53.927 INFO:teuthology.orchestra.run.smithi195.stderr: 89.8% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mgr.x.log.gz 2024-01-21T07:53:54.082 INFO:teuthology.orchestra.run.smithi080.stderr: 92.8% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.2.log.gz 2024-01-21T07:53:54.116 INFO:teuthology.orchestra.run.smithi080.stderr: 91.8% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mgr.y.log.gz 2024-01-21T07:53:54.219 INFO:teuthology.orchestra.run.smithi195.stderr: 93.0% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.5.log.gz 2024-01-21T07:53:54.251 INFO:teuthology.orchestra.run.smithi195.stderr: 93.2% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.7.log.gz 2024-01-21T07:53:54.291 INFO:teuthology.orchestra.run.smithi195.stderr: 93.3% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.4.log.gz 2024-01-21T07:53:54.303 INFO:teuthology.orchestra.run.smithi195.stderr: 92.8% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.6.log.gz 2024-01-21T07:53:54.308 INFO:teuthology.orchestra.run.smithi080.stderr: 93.1% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.0.log.gz 2024-01-21T07:53:54.330 INFO:teuthology.orchestra.run.smithi080.stderr: 93.3% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.3.log.gz 2024-01-21T07:53:54.360 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.c.log.gz 2024-01-21T07:53:54.373 INFO:teuthology.orchestra.run.smithi080.stderr: 93.4% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-osd.1.log.gz 2024-01-21T07:53:54.409 INFO:teuthology.orchestra.run.smithi195.stderr: 93.3% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.b.log.gz 2024-01-21T07:53:54.410 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-01-21T07:53:54.411 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m0.568s 2024-01-21T07:53:54.411 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m2.147s 2024-01-21T07:53:54.411 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.095s 2024-01-21T07:53:54.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:54 smithi080 bash[36089]: level=error ts=2024-01-21T07:53:54.242Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:53:54.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:54 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:54.242Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:53:54.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:53:54 smithi080 bash[36089]: level=warn ts=2024-01-21T07:53:54.243Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused" 2024-01-21T07:53:54.655 INFO:teuthology.orchestra.run.smithi080.stderr: 91.2% -- replaced with /var/log/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/ceph-mon.a.log.gz 2024-01-21T07:53:54.657 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-01-21T07:53:54.657 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m0.842s 2024-01-21T07:53:54.657 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m3.225s 2024-01-21T07:53:54.657 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.137s 2024-01-21T07:53:54.657 INFO:tasks.cephadm:Archiving logs... 2024-01-21T07:53:54.658 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/remote/ubuntu@smithi080.front.sepia.ceph.com/log 2024-01-21T07:53:54.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-21T07:53:55.061 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/remote/ubuntu@smithi195.front.sepia.ceph.com/log 2024-01-21T07:53:55.062 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-21T07:53:55.350 INFO:tasks.cephadm:Removing cluster... 2024-01-21T07:53:55.351 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b86415d2-b82f-11ee-95b0-87774f69a715 --force 2024-01-21T07:54:04.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:04 smithi080 bash[36089]: level=error ts=2024-01-21T07:54:04.242Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:54:04.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:04 smithi080 bash[36089]: level=warn ts=2024-01-21T07:54:04.243Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-01-21T07:54:04.560 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:04 smithi080 bash[36089]: level=warn ts=2024-01-21T07:54:04.245Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi195.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.195:8443: connect: connection refused" 2024-01-21T07:54:08.697 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:08 smithi080 systemd[1]: Stopping Ceph alertmanager.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:54:08.697 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:08 smithi080 bash[45028]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-alertmanager.a 2024-01-21T07:54:09.058 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:08 smithi080 bash[36089]: level=info ts=2024-01-21T07:54:08.695Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-01-21T07:54:09.558 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:09 smithi080 bash[45059]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-alertmanager-a 2024-01-21T07:54:09.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:09 smithi080 bash[45130]: Error response from daemon: No such container: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-alertmanager-a 2024-01-21T07:54:09.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:09 smithi080 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@alertmanager.a.service: Succeeded. 2024-01-21T07:54:09.559 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Jan 21 07:54:09 smithi080 systemd[1]: Stopped Ceph alertmanager.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:54:09.909 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b86415d2-b82f-11ee-95b0-87774f69a715 --force 2024-01-21T07:54:11.889 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 systemd[1]: Stopping Ceph grafana.a for b86415d2-b82f-11ee-95b0-87774f69a715... 2024-01-21T07:54:11.889 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-01-21T07:54:11.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2024-01-21T07:54:11.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2024-01-21T07:54:11.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2024-01-21T07:54:11.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2024-01-21T07:54:11.890 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2024-01-21T07:54:11.891 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2024-01-21T07:54:11.891 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2024-01-21T07:54:11.891 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2024-01-21T07:54:11.891 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2024-01-21T07:54:11.892 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped Stream Manager" 2024-01-21T07:54:11.892 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2024-01-21T07:54:11.892 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:11 smithi195 bash[27573]: t=2024-01-21T07:54:11+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2024-01-21T07:54:12.638 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:12 smithi195 bash[33164]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715-grafana.a 2024-01-21T07:54:12.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:12 smithi195 bash[33213]: bash: /var/lib/ceph/b86415d2-b82f-11ee-95b0-87774f69a715/grafana.a/unit.stop: No such file or directory 2024-01-21T07:54:12.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:12 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-01-21T07:54:12.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:12 smithi195 systemd[1]: ceph-b86415d2-b82f-11ee-95b0-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-01-21T07:54:12.639 INFO:journalctl@ceph.grafana.a.smithi195.stdout:Jan 21 07:54:12 smithi195 systemd[1]: Stopped Ceph grafana.a for b86415d2-b82f-11ee-95b0-87774f69a715. 2024-01-21T07:54:24.690 INFO:tasks.cephadm:Removing cephadm ... 2024-01-21T07:54:24.690 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-21T07:54:24.698 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-21T07:54:24.702 INFO:tasks.cephadm:Teardown complete 2024-01-21T07:54:24.703 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-21T07:54:24.712 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-21T07:54:24.712 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T07:54:24.714 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T07:54:24.733 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-01-21T07:54:24.734 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-01-21T07:54:24.734 INFO:teuthology.orchestra.run.smithi080.stdout:*hv01.front.sepi 44.4.53.2 2 u 60 64 377 0.093 -0.617 0.246 2024-01-21T07:54:24.734 INFO:teuthology.orchestra.run.smithi080.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 377 0.097 1.340 0.303 2024-01-21T07:54:24.734 INFO:teuthology.orchestra.run.smithi080.stdout:+hv03.front.sepi 74.6.168.72 3 u 48 64 377 0.092 -0.245 0.124 2024-01-21T07:54:24.735 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-01-21T07:54:24.737 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-01-21T07:54:24.737 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-01-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi195.stdout:*hv01.front.sepi 44.4.53.2 2 u 51 64 377 0.078 1.428 0.628 2024-01-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi195.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 377 0.097 3.094 0.708 2024-01-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi195.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 377 0.080 0.675 0.721 2024-01-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-01-21T07:54:24.739 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-21T07:54:24.752 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-21T07:54:24.754 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-21T07:54:24.765 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-21T07:54:24.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-21T07:54:24.784 INFO:teuthology.task.internal:Duration was 1427.876611 seconds 2024-01-21T07:54:24.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-21T07:54:24.815 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-21T07:54:24.816 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-21T07:54:24.818 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-21T07:54:24.872 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-21T07:54:24.872 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-01-21T07:54:24.872 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-21T07:54:24.884 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-01-21T07:54:24.884 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-21T07:54:24.898 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-21T07:54:24.898 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-21T07:54:24.900 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-21T07:54:24.980 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-21T07:54:24.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-21T07:54:24.982 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-21T07:54:25.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-21T07:54:25.173 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-21T07:54:25.173 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-21T07:54:25.189 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-21T07:54:25.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-21T07:54:25.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-21T07:54:25.217 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-21T07:54:25.229 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-01-21T07:54:25.229 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-01-21T07:54:25.266 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-21T07:54:25.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T07:54:25.304 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-21T07:54:25.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T07:54:25.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-21T07:54:25.324 INFO:teuthology.task.internal:Transferring archived files... 2024-01-21T07:54:25.325 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/remote/smithi080 2024-01-21T07:54:25.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-21T07:54:25.360 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236/remote/smithi195 2024-01-21T07:54:25.361 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-21T07:54:25.392 INFO:teuthology.task.internal:Removing archive directory... 2024-01-21T07:54:25.392 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-21T07:54:25.397 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-21T07:54:25.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-21T07:54:25.414 INFO:teuthology.task.internal:Not uploading archives. 2024-01-21T07:54:25.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-21T07:54:25.429 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-21T07:54:25.429 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-21T07:54:25.431 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-21T07:54:25.437 INFO:teuthology.orchestra.run.smithi080.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 21 07:54 /home/ubuntu/cephtest 2024-01-21T07:54:25.452 INFO:teuthology.orchestra.run.smithi195.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 21 07:54 /home/ubuntu/cephtest 2024-01-21T07:54:25.455 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-21T07:54:25.464 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-21T07:54:25.487 INFO:teuthology.nuke:Checking targets against current locks 2024-01-21T07:54:25.514 DEBUG:teuthology.nuke:shortname: smithi080 2024-01-21T07:54:25.514 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T07:54:25.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 07:21:34.704896', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-01-21T07:54:25.543 DEBUG:teuthology.nuke:shortname: smithi195 2024-01-21T07:54:25.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T07:54:25.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:17:02-rados-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 07:21:34.703152', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-01-21T07:54:25.597 INFO:teuthology.orchestra.console.smithi080:Power off 2024-01-21T07:54:25.598 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T07:54:25.621 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-01-21T07:54:25.621 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T07:54:25.638 INFO:teuthology.orchestra.console.smithi195:Power off 2024-01-21T07:54:25.639 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T07:54:25.649 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-21T07:54:25.662 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-01-21T07:54:25.662 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T07:54:25.685 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-01-21T07:54:29.651 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T07:54:29.686 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T07:54:29.762 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-01-21T07:54:29.797 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-01-21T07:54:33.768 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T07:54:33.798 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T07:54:33.878 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-01-21T07:54:33.908 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-01-21T07:54:33.980 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-01-21T07:54:34.009 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-01-21T07:54:34.114 INFO:teuthology.run:Summary data: description: rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} duration: 1427.8766112327576 failure_reason: 'Command failed on smithi080 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b86415d2-b82f-11ee-95b0-87774f69a715 -e sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7ab95b784773411ea3ecfb0c146ec6c3 status: fail success: false 2024-01-21T07:54:34.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T07:54:34.198 INFO:teuthology.run:FAIL